Commit Graph

133 Commits

Author SHA1 Message Date
oysteikt e67d906b3c WIP: add kanjivg data
Build and test / evals (push) Successful in 37m9s
2026-03-03 13:47:59 +09:00
oysteikt 0f7854a4fc migrations: add version tables for all data sources
Build and test / evals (push) Successful in 11m34s
2026-03-03 12:59:58 +09:00
oysteikt a86f857553 util/romaji_transliteration: add functions to generate transliteration spans
Build and test / evals (push) Successful in 18m58s
2026-03-02 18:23:36 +09:00
oysteikt d14e3909d4 search/filter_kanji: keep order when deduplicating
Build and test / evals (push) Successful in 13m33s
2026-03-02 17:37:45 +09:00
oysteikt dcf5c8ebe7 lemmatizer: implement equality for AllomorphPattern/LemmatizationRule 2026-03-02 12:01:13 +09:00
oysteikt 1f8bc8bac5 lemmatizer: let LemmatizationRule.validChildClasses be a set 2026-03-02 12:01:13 +09:00
oysteikt ab28b5788b search/word_search: fix english queries without pageSize/offset 2026-03-02 12:01:13 +09:00
oysteikt 63a4caa626 lemmatizer/rules/ichidan: add informal conditionals 2026-03-02 12:01:12 +09:00
oysteikt 4a6fd41f31 lemmatizer: misc small improvements 2026-03-02 12:01:12 +09:00
oysteikt c06fff9e5a lemmatizer/rules: name all rules as separate static variables 2026-03-02 12:01:12 +09:00
oysteikt 1d9928ade1 search/kanji: split queries into separate functions 2026-03-02 12:01:11 +09:00
oysteikt 1a3b04be00 word_search_result: add romanization getters 2026-03-02 12:01:11 +09:00
oysteikt c0c6f97a01 search/word_search: fix casing of SearchMode variants 2026-03-02 12:01:11 +09:00
oysteikt a954188d5d Fix a few lints 2026-03-02 12:01:11 +09:00
oysteikt 72f31e974b dart format 2026-03-02 12:01:10 +09:00
oysteikt e824dc0a22 search/word_search: split data queries into functions 2026-03-02 12:01:10 +09:00
oysteikt a696ed9733 Generate matchspans for word search results
Run tests / evals (push) Failing after 12m29s
Build database / evals (push) Successful in 12m36s
2026-02-24 21:27:12 +09:00
oysteikt 8ae1d882a0 Add TODO for word matching
Build database / evals (push) Successful in 12m32s
2026-02-24 15:21:03 +09:00
oysteikt 81db60ccf7 Add some docstrings
Build database / evals (push) Has been cancelled
2026-02-24 15:13:33 +09:00
oysteikt f57cc68ef3 search/radicals: deduplicate input radicals before search 2026-02-24 15:08:19 +09:00
oysteikt 48f50628a1 Create empty() factory for word search results
Build database / evals (push) Successful in 35m56s
2026-02-23 13:01:57 +09:00
oysteikt 05b56466e7 tanos-jlpt: fix breaking changes for csv parser 2026-02-21 00:46:24 +09:00
oysteikt 98d92d370d {flake.lock,pubspec.lock}: bump, source libsqlite via hooks 2026-02-09 14:44:14 +09:00
oysteikt 45e8181041 search/kanji: don't transliterate onyomi to katakana 2025-07-30 01:37:26 +02:00
oysteikt bb68319527 treewide: add and apply a bunch of lints 2025-07-17 00:24:35 +02:00
oysteikt 2803db9c12 bin/query-word: fix default pagination 2025-07-16 18:32:47 +02:00
oysteikt 93b76ed660 word_search: include data for cross references 2025-07-16 18:32:28 +02:00
oysteikt 29a3a6aafb treewide: dart format 2025-07-16 15:23:04 +02:00
oysteikt 0a3387e77a search: add function for fetching multiple kanji at once 2025-07-15 00:58:16 +02:00
oysteikt f30465a33c search: add function for fetching multiple word entries by id at once 2025-07-15 00:52:25 +02:00
oysteikt d9006a0767 word_search: fix count query 2025-07-13 20:34:39 +02:00
oysteikt 37d29fc6ad cli/query_word: add flags for pagination 2025-07-13 20:12:22 +02:00
oysteikt 60898fe9a2 word_search: fix pagination 2025-07-13 20:12:10 +02:00
oysteikt 5049157b02 cli/query_word: add --json flag 2025-07-13 16:27:11 +02:00
oysteikt 1868c6fb41 word_search: don't throw error on empty results 2025-07-09 14:57:19 +02:00
oysteikt 7247af19cb word_search: always order exact matches first 2025-07-07 13:27:50 +02:00
oysteikt ac7deae608 word_search: remove duplicate results 2025-07-07 12:47:20 +02:00
oysteikt 7978b74f8d lib/{_data_ingestion/search}: store kanjidic onyomi as hiragana 2025-06-25 20:18:28 +02:00
oysteikt 50870f64a0 cli/query_kanji: remove -k flag, use arguments 2025-06-25 20:18:27 +02:00
oysteikt 62d77749e6 cli/query_word: allow querying with jmdict id 2025-06-25 20:18:27 +02:00
oysteikt 80b3610a72 Store type enum as CHAR(1) 2025-06-25 20:18:27 +02:00
oysteikt 54705c3c10 word_search: add TODO 2025-06-24 23:04:47 +02:00
oysteikt aac9bf69f6 cli/create_db: return an erroneous exit on on error 2025-06-24 19:33:09 +02:00
oysteikt c32775ce7a use ids for \{kanji,reading\}Element tables 2025-06-24 19:33:02 +02:00
oysteikt 78f546fa28 models/createEmptyDb: init 2025-06-23 21:11:42 +02:00
oysteikt e0a35bdef9 lib: fix file name style 2025-06-22 12:48:23 +02:00
oysteikt 8ec9771222 word_search: add '.' filter for FTS input 2025-06-20 23:27:15 +02:00
oysteikt e2fe033bf4 word_search: fix english search, filter '%' 2025-06-20 23:23:09 +02:00
oysteikt a6a48c196d word_search: filter input for FTS chars 2025-06-20 23:10:10 +02:00
oysteikt b855a1dc48 filter_kanji: fix implementation, add test 2025-06-20 22:44:26 +02:00