Commit Graph

88 Commits

Author SHA1 Message Date
oysteikt 84ae7eca9e lib/search/word_search: move some score calculation to virtual column 2025-05-16 21:03:37 +02:00
oysteikt 45c4c5f09a lib/cli/query-word: stringify 2025-05-16 18:47:26 +02:00
oysteikt 369fcdbd4b lib/search/word_search: fix rubification 2025-05-16 18:46:57 +02:00
oysteikt 33cf5028f4 lib/search/word_search: score and order results by several metrics 2025-05-16 18:46:39 +02:00
oysteikt 90d5717928 migrations: move JMdict views to 0009_views 2025-05-16 18:43:58 +02:00
oysteikt bb9550380c lib/search/word_search: limit entry id query to single column 2025-05-16 17:06:01 +02:00
oysteikt 3680827176 lib/search/word_search: use const table names 2025-05-16 17:06:01 +02:00
oysteikt 9d9ce840fa lib/search/word_search: split 2025-05-16 17:06:00 +02:00
oysteikt 6c580e95e2 lib/search/word_search: pagination 2025-05-16 17:06:00 +02:00
oysteikt 2db99e76f0 lib/_data_ingestion: perform VACUUM after data ingestion 2025-05-16 17:06:00 +02:00
oysteikt 42db69e57a lib/cli/create_db: make WAL mode optional 2025-05-16 17:05:59 +02:00
oysteikt 4407c06f12 lib/cli: add timing logs to query commands 2025-05-16 17:05:59 +02:00
oysteikt fc0956d5c3 lib/text_filtering: add kanjiRegex 2025-05-16 17:05:57 +02:00
oysteikt d7f7f9cd19 Filter data out into separate files 2025-05-16 09:22:28 +02:00
oysteikt cf95f85caa Add kanji filtering utility 2025-05-16 09:17:18 +02:00
oysteikt f278b34415 lib/_data_ingestion: enable WAL 2025-05-15 22:31:54 +02:00
oysteikt 30d8160698 migrations: add FTS tables + view for querying example words 2025-05-15 13:03:48 +02:00
oysteikt b07fc8f4b3 lib/word_search: calculate isCommon 2025-05-14 20:59:57 +02:00
oysteikt 8299572225 migrations: add view for base/furigana queries 2025-05-14 17:12:31 +02:00
oysteikt 78ba1bae1a lib/search: query readings for xrefs 2025-05-14 17:12:31 +02:00
oysteikt 87383c8951 lib/search: query jlpt tags on word search 2025-05-14 17:12:31 +02:00
oysteikt cd9b318956 lib/cli/create_db: await seeding data 2025-05-14 17:12:30 +02:00
oysteikt 96f52b5860 lib/_data_ingestion/tanos-jlpt: report sql errors 2025-05-14 17:12:30 +02:00
oysteikt 59e8db5add Query more detailed information about langauge source 2025-05-14 17:12:30 +02:00
oysteikt 9038119eb7 Consistently use senseId name everywhere 2025-05-14 17:12:29 +02:00
oysteikt 3290d5dc91 Consistently use entryId name everywhere 2025-05-14 17:12:29 +02:00
oysteikt 4647ab2286 flake.nix: add sqlite-analyzer to devshell 2025-05-14 17:12:29 +02:00
oysteikt 2980bcda06 lib/_data_ingestion/jmdict: format 2025-05-14 17:12:29 +02:00
oysteikt 1661817819 migrations/JMDict: add extra constraints, clean up pkeys, etc. 2025-05-14 17:12:28 +02:00
oysteikt 581f9daf25 lib/_data_ingestion: add phrases for language source data 2025-05-14 17:12:28 +02:00
oysteikt 9898793bca Convert entryBy* tables into views 2025-05-14 17:12:28 +02:00
oysteikt 2e7e8851e1 pubspec.yaml: relax deps 2025-05-13 22:19:02 +02:00
oysteikt 10e74e3f43 Add tanos jlpt tags to database 2025-05-13 21:32:22 +02:00
oysteikt 68200fab00 README: update list of sources 2025-05-13 21:26:18 +02:00
oysteikt f403237f1d Add data from tanos.co/jlpt 2025-05-13 21:26:18 +02:00
oysteikt c43a29a398 lib/_data_ingestion: don't return results on batch db commits 2025-05-13 21:26:17 +02:00
oysteikt c379bc8019 lib/_data_ingestion: await RADKFILE seeding 2025-05-13 11:51:56 +02:00
oysteikt 8ddba55e43 lib/util: move escapeStringValue to sqlite utils 2025-05-13 11:51:55 +02:00
oysteikt 7abdb7f02f migrations/JMdict: index common text fields 2025-05-13 11:51:55 +02:00
oysteikt 39f5826eaa lib/_data_ingestion: improve openLocalDB 2025-04-30 10:00:22 +02:00
oysteikt 1fdcb7a477 bin/jadb: split 2025-04-30 08:48:00 +02:00
oysteikt 4357485870 lib/util/romaji_trx: add and 2025-04-29 13:58:25 +02:00
oysteikt 0214473120 lib/_data_ingestion: split parsing and seeding steps 2025-04-29 13:29:31 +02:00
oysteikt 38706c0532 lib/util: add several utils from jptools 2025-04-29 12:14:40 +02:00
oysteikt 929be590ee Move gitignored data sources to data/tmp 2025-04-29 10:33:11 +02:00
oysteikt 1f77fdeea9 flake.nix: add main executable as app 2025-04-29 10:30:39 +02:00
oysteikt c98c0e04f2 flake.lock: bump 2025-04-28 21:58:27 +02:00
oysteikt 3f71775f27 Add tests 2025-04-28 21:58:06 +02:00
oysteikt 946adb90cc Add jouyou kanji as constant data 2025-04-28 21:57:53 +02:00
oysteikt b6410c717f Implement word search 2025-04-28 21:53:09 +02:00