Commit Graph

202 Commits

Author SHA1 Message Date
oysteikt 501d3a089e lib/search/radical_search: implement 2025-05-19 16:40:35 +02:00
oysteikt e0ffd89ff4 lib/search/word_search: use map comprehensions 2025-05-19 16:40:35 +02:00
oysteikt e30ed8ba9b lib/search/kanji: add more data to result 2025-05-19 16:40:34 +02:00
oysteikt d508b5e244 migrations: add constraint for kanjidic skip misclassifications 2025-05-19 16:40:34 +02:00
oysteikt 31c3fb807e treewide: redo handling of kanjidic radicals 2025-05-19 16:40:34 +02:00
oysteikt 60d2017473 lib/search/kanji: add codepoints 2025-05-19 16:40:33 +02:00
oysteikt 135d81db80 lib/search/kanji: query kanji parts 2025-05-19 16:40:33 +02:00
oysteikt f8549bf55a lib/_data_ingestion/kanjidic: correctly parse radical names from xml 2025-05-19 16:40:33 +02:00
oysteikt 69d86b34ff migrations: remove already fixed TODO 2025-05-19 16:40:30 +02:00
oysteikt 6d7c068e7b lib/search/word_search: query reading/kanji elements in correct order 2025-05-18 23:53:30 +02:00
oysteikt b6661c734f lib/search/word_search: add word count search 2025-05-16 23:50:01 +02:00
oysteikt 080638e7ef lib/search/word_search: assert no missing rubys 2025-05-16 21:30:33 +02:00
oysteikt 03d536d7d1 nix: add package for database with WAL enabled 2025-05-16 21:29:53 +02:00
oysteikt 3f267b78d3 lib: format 2025-05-16 21:06:19 +02:00
oysteikt 84ae7eca9e lib/search/word_search: move some score calculation to virtual column 2025-05-16 21:03:37 +02:00
oysteikt 45c4c5f09a lib/cli/query-word: stringify 2025-05-16 18:47:26 +02:00
oysteikt 369fcdbd4b lib/search/word_search: fix rubification 2025-05-16 18:46:57 +02:00
oysteikt 33cf5028f4 lib/search/word_search: score and order results by several metrics 2025-05-16 18:46:39 +02:00
oysteikt 90d5717928 migrations: move JMdict views to 0009_views 2025-05-16 18:43:58 +02:00
oysteikt bb9550380c lib/search/word_search: limit entry id query to single column 2025-05-16 17:06:01 +02:00
oysteikt 3680827176 lib/search/word_search: use const table names 2025-05-16 17:06:01 +02:00
oysteikt 9d9ce840fa lib/search/word_search: split 2025-05-16 17:06:00 +02:00
oysteikt 6c580e95e2 lib/search/word_search: pagination 2025-05-16 17:06:00 +02:00
oysteikt 2db99e76f0 lib/_data_ingestion: perform VACUUM after data ingestion 2025-05-16 17:06:00 +02:00
oysteikt 42db69e57a lib/cli/create_db: make WAL mode optional 2025-05-16 17:05:59 +02:00
oysteikt 4407c06f12 lib/cli: add timing logs to query commands 2025-05-16 17:05:59 +02:00
oysteikt fc0956d5c3 lib/text_filtering: add kanjiRegex 2025-05-16 17:05:57 +02:00
oysteikt d7f7f9cd19 Filter data out into separate files 2025-05-16 09:22:28 +02:00
oysteikt cf95f85caa Add kanji filtering utility 2025-05-16 09:17:18 +02:00
oysteikt f278b34415 lib/_data_ingestion: enable WAL 2025-05-15 22:31:54 +02:00
oysteikt 30d8160698 migrations: add FTS tables + view for querying example words 2025-05-15 13:03:48 +02:00
oysteikt b07fc8f4b3 lib/word_search: calculate isCommon 2025-05-14 20:59:57 +02:00
oysteikt 8299572225 migrations: add view for base/furigana queries 2025-05-14 17:12:31 +02:00
oysteikt 78ba1bae1a lib/search: query readings for xrefs 2025-05-14 17:12:31 +02:00
oysteikt 87383c8951 lib/search: query jlpt tags on word search 2025-05-14 17:12:31 +02:00
oysteikt cd9b318956 lib/cli/create_db: await seeding data 2025-05-14 17:12:30 +02:00
oysteikt 96f52b5860 lib/_data_ingestion/tanos-jlpt: report sql errors 2025-05-14 17:12:30 +02:00
oysteikt 59e8db5add Query more detailed information about langauge source 2025-05-14 17:12:30 +02:00
oysteikt 9038119eb7 Consistently use senseId name everywhere 2025-05-14 17:12:29 +02:00
oysteikt 3290d5dc91 Consistently use entryId name everywhere 2025-05-14 17:12:29 +02:00
oysteikt 4647ab2286 flake.nix: add sqlite-analyzer to devshell 2025-05-14 17:12:29 +02:00
oysteikt 2980bcda06 lib/_data_ingestion/jmdict: format 2025-05-14 17:12:29 +02:00
oysteikt 1661817819 migrations/JMDict: add extra constraints, clean up pkeys, etc. 2025-05-14 17:12:28 +02:00
oysteikt 581f9daf25 lib/_data_ingestion: add phrases for language source data 2025-05-14 17:12:28 +02:00
oysteikt 9898793bca Convert entryBy* tables into views 2025-05-14 17:12:28 +02:00
oysteikt 2e7e8851e1 pubspec.yaml: relax deps 2025-05-13 22:19:02 +02:00
oysteikt 10e74e3f43 Add tanos jlpt tags to database 2025-05-13 21:32:22 +02:00
oysteikt 68200fab00 README: update list of sources 2025-05-13 21:26:18 +02:00
oysteikt f403237f1d Add data from tanos.co/jlpt 2025-05-13 21:26:18 +02:00
oysteikt c43a29a398 lib/_data_ingestion: don't return results on batch db commits 2025-05-13 21:26:17 +02:00