Commit Graph

148 Commits

Author SHA1 Message Date
oysteikt 507f1a21d8 jmdict: store glossary type in different table
Build and test / build (push) Failing after 6m34s
2026-04-13 19:43:25 +09:00
oysteikt 556d07913d jmdict: don't store glossary language 2026-04-13 19:42:11 +09:00
oysteikt 15540514f6 jmdict: don't store kanji + reading for xrefs
Build and test / build (push) Successful in 7m0s
2026-04-13 18:33:06 +09:00
oysteikt 4faf543d6e jmdict: don't store empty entry scores
Build and test / build (push) Successful in 8m17s
2026-04-13 18:18:48 +09:00
oysteikt d1a6f39cca kanjidic: split grade/freq/jlpt into separate tables
Build and test / build (push) Successful in 8m1s
2026-04-09 14:10:51 +09:00
oysteikt a222b2d9b8 jmdict: elementId instead of reading for element restriction tables
Build and test / build (push) Successful in 8m0s
2026-04-08 19:57:07 +09:00
oysteikt 5d26b41524 jmdict: embed element type (k/r) into elementId 2026-04-08 19:05:02 +09:00
oysteikt f6de8680ad jmdict: infer entryId from element ids 2026-04-08 18:01:16 +09:00
oysteikt 99218a6987 jmdict: embed orderNum in senseId for senses 2026-04-08 17:21:50 +09:00
oysteikt e8ee1ab944 data_ingestion/tanos-jlpt: remove redundant code import 2026-04-08 17:21:49 +09:00
oysteikt 4f320e4ea9 jmdict: embed orderNum in elementId for kanji and readings 2026-04-08 17:21:49 +09:00
oysteikt 8d742b92be flake.nix: pull tanos jlpt data from datasources repo
Build and test / build (push) Has been cancelled
2026-04-08 13:34:25 +09:00
oysteikt 9b9c771eff flake.nix: pull datasources from datasources repo
Build and test / build (push) Failing after 8m19s
2026-04-07 17:26:47 +09:00
oysteikt 61ac226fc3 word_search_result: add getter for unusual kanji flag
Build and test / build (push) Successful in 11m48s
2026-04-02 15:53:39 +09:00
oysteikt 2ad1e038f1 tanos-jlpt: remove flatten from xml stream
Build and test / build (push) Successful in 13m41s
This was earlier used to compensate for a double nesting bug. This has
been fixed in the latest version of the xml package.
2026-04-01 16:04:44 +09:00
oysteikt f40825de65 jmdict: skip inserting duplicate xrefs 2026-04-01 16:03:56 +09:00
oysteikt 0f7854a4fc migrations: add version tables for all data sources
Build and test / evals (push) Successful in 11m34s
2026-03-03 12:59:58 +09:00
oysteikt a86f857553 util/romaji_transliteration: add functions to generate transliteration spans
Build and test / evals (push) Successful in 18m58s
2026-03-02 18:23:36 +09:00
oysteikt d14e3909d4 search/filter_kanji: keep order when deduplicating
Build and test / evals (push) Successful in 13m33s
2026-03-02 17:37:45 +09:00
oysteikt dcf5c8ebe7 lemmatizer: implement equality for AllomorphPattern/LemmatizationRule 2026-03-02 12:01:13 +09:00
oysteikt 1f8bc8bac5 lemmatizer: let LemmatizationRule.validChildClasses be a set 2026-03-02 12:01:13 +09:00
oysteikt ab28b5788b search/word_search: fix english queries without pageSize/offset 2026-03-02 12:01:13 +09:00
oysteikt 63a4caa626 lemmatizer/rules/ichidan: add informal conditionals 2026-03-02 12:01:12 +09:00
oysteikt 4a6fd41f31 lemmatizer: misc small improvements 2026-03-02 12:01:12 +09:00
oysteikt c06fff9e5a lemmatizer/rules: name all rules as separate static variables 2026-03-02 12:01:12 +09:00
oysteikt 1d9928ade1 search/kanji: split queries into separate functions 2026-03-02 12:01:11 +09:00
oysteikt 1a3b04be00 word_search_result: add romanization getters 2026-03-02 12:01:11 +09:00
oysteikt c0c6f97a01 search/word_search: fix casing of SearchMode variants 2026-03-02 12:01:11 +09:00
oysteikt a954188d5d Fix a few lints 2026-03-02 12:01:11 +09:00
oysteikt 72f31e974b dart format 2026-03-02 12:01:10 +09:00
oysteikt e824dc0a22 search/word_search: split data queries into functions 2026-03-02 12:01:10 +09:00
oysteikt a696ed9733 Generate matchspans for word search results
Run tests / evals (push) Failing after 12m29s
Build database / evals (push) Successful in 12m36s
2026-02-24 21:27:12 +09:00
oysteikt 8ae1d882a0 Add TODO for word matching
Build database / evals (push) Successful in 12m32s
2026-02-24 15:21:03 +09:00
oysteikt 81db60ccf7 Add some docstrings
Build database / evals (push) Has been cancelled
2026-02-24 15:13:33 +09:00
oysteikt f57cc68ef3 search/radicals: deduplicate input radicals before search 2026-02-24 15:08:19 +09:00
oysteikt 48f50628a1 Create empty() factory for word search results
Build database / evals (push) Successful in 35m56s
2026-02-23 13:01:57 +09:00
oysteikt 05b56466e7 tanos-jlpt: fix breaking changes for csv parser 2026-02-21 00:46:24 +09:00
oysteikt 98d92d370d {flake.lock,pubspec.lock}: bump, source libsqlite via hooks 2026-02-09 14:44:14 +09:00
oysteikt 45e8181041 search/kanji: don't transliterate onyomi to katakana 2025-07-30 01:37:26 +02:00
oysteikt bb68319527 treewide: add and apply a bunch of lints 2025-07-17 00:24:35 +02:00
oysteikt 2803db9c12 bin/query-word: fix default pagination 2025-07-16 18:32:47 +02:00
oysteikt 93b76ed660 word_search: include data for cross references 2025-07-16 18:32:28 +02:00
oysteikt 29a3a6aafb treewide: dart format 2025-07-16 15:23:04 +02:00
oysteikt 0a3387e77a search: add function for fetching multiple kanji at once 2025-07-15 00:58:16 +02:00
oysteikt f30465a33c search: add function for fetching multiple word entries by id at once 2025-07-15 00:52:25 +02:00
oysteikt d9006a0767 word_search: fix count query 2025-07-13 20:34:39 +02:00
oysteikt 37d29fc6ad cli/query_word: add flags for pagination 2025-07-13 20:12:22 +02:00
oysteikt 60898fe9a2 word_search: fix pagination 2025-07-13 20:12:10 +02:00
oysteikt 5049157b02 cli/query_word: add --json flag 2025-07-13 16:27:11 +02:00
oysteikt 1868c6fb41 word_search: don't throw error on empty results 2025-07-09 14:57:19 +02:00