Commit Graph

Select branches

Hide Pull Requests

add-kanjivg-data

kanji-reading-element-ids

main

remove-sense-glossary-phrase-index

split-news-ichi-gai-tables

sqlite-fts5-icu-tokenizer

sqlite-icu

word-regrouping-optimization

mugiten-v0.3.0

mugiten-v0.3.1

mugiten-v0.4.0

v0.5.0

v0.6.0

Mono Color

• 41d990a447 WIP sqlite-fts5-icu-tokenizer oysteikt 2026-05-06 02:00:10 +09:00
• efda41a526 WIP sqlite-icu oysteikt 2026-05-06 01:39:04 +09:00
• c43285c78a .gitea/workflows/build-and-test: don't autoupdate datasources main oysteikt 2026-05-06 00:19:59 +09:00
• c22e96b7f9 flake.lock: bump nixpkgs oysteikt 2026-05-06 00:13:32 +09:00
• d3516495ab data_ingestion/jmdict: throw proper errors on invalid xrefs oysteikt 2026-05-05 23:48:05 +09:00
• be4dd72dcb migrations/JMdict: no default value for EntryScore.score oysteikt 2026-05-05 23:23:01 +09:00
• 32ec34a150 migrations/JMdict: only index common entries in EntryScore_byCommon oysteikt 2026-05-05 23:22:37 +09:00
• bd0822b740 .gitea/workflows/build-and-test: remove duplicate nix config oysteikt 2026-04-29 08:39:52 +09:00
• 8827893101 search: prefer Iterable over List in some public APIs oysteikt 2026-04-14 17:55:40 +09:00
• 28c4403e2d test/romaji_transliteration: add tests for iteration marks and yori ligature oysteikt 2026-04-13 22:06:03 +09:00
• d168f07563 WIP remove-sense-glossary-phrase-index oysteikt 2026-04-13 21:10:56 +09:00
• d13138f8a5 Add datasource versions to database oysteikt 2026-04-13 21:00:39 +09:00
• cbaa9ec6b3 benchmark: create separate benchmarks for jp and en search oysteikt 2026-04-13 20:18:43 +09:00
• d1e2fa3748 test/search/radical_search: skip failing tests for now oysteikt 2026-04-13 19:51:18 +09:00
• 3f4fdf470d jmdict: store glossary type in different table oysteikt 2026-04-13 19:43:25 +09:00
• 556d07913d jmdict: don't store glossary language oysteikt 2026-04-13 19:42:11 +09:00
• 6165045ea7 migrations: simplify JMdict_CombinedEntryScore oysteikt 2026-04-13 19:29:04 +09:00
• 316dff3b46 migrations: comment out unused jmdict <-> kanjidic xref table oysteikt 2026-04-13 19:14:30 +09:00
• 747e680a02 migrations: remove some excessive indices oysteikt 2026-04-13 19:13:31 +09:00
• 4f73e07056 test/search/radical_search: init oysteikt 2026-04-13 19:12:15 +09:00
• 15540514f6 jmdict: don't store kanji + reading for xrefs oysteikt 2026-04-13 18:33:06 +09:00
• 4faf543d6e jmdict: don't store empty entry scores oysteikt 2026-04-13 18:16:19 +09:00
• 8df3db4c77 WIP: add kanjivg data add-kanjivg-data oysteikt 2026-03-03 13:47:59 +09:00
• d1a6f39cca kanjidic: split grade/freq/jlpt into separate tables oysteikt 2026-04-09 14:10:51 +09:00
• a222b2d9b8 jmdict: elementId instead of reading for element restriction tables oysteikt 2026-04-08 19:57:07 +09:00
• 6364457d9e docs/database: add some notes about elementId embeddings oysteikt 2026-04-08 19:07:48 +09:00
• 5d26b41524 jmdict: embed element type (k/r) into elementId oysteikt 2026-04-08 19:05:02 +09:00
• 114febbe02 docs/database: add some notes about JMdict_EntryScore oysteikt 2026-04-08 18:14:28 +09:00
• 20243dec09 docs: add docs about database schema choices oysteikt 2026-04-08 17:38:08 +09:00
• f6de8680ad jmdict: infer entryId from element ids oysteikt 2026-04-08 17:37:52 +09:00
• 99218a6987 jmdict: embed orderNum in senseId for senses oysteikt 2026-04-08 16:38:42 +09:00
• e8ee1ab944 data_ingestion/tanos-jlpt: remove redundant code import oysteikt 2026-04-08 16:28:36 +09:00
• 4f320e4ea9 jmdict: embed orderNum in elementId for kanji and readings oysteikt 2026-04-08 16:27:19 +09:00
• 9c9f5543c8 .gitea/workflows: fix 'update database inputs' step oysteikt 2026-04-08 14:05:28 +09:00
• be493a6150 .gitea/workflows: fix build-and-test job oysteikt 2026-04-08 13:36:42 +09:00
• 8d742b92be flake.nix: pull tanos jlpt data from datasources repo oysteikt 2026-04-08 13:34:25 +09:00
• 9b9c771eff flake.nix: pull datasources from datasources repo oysteikt 2026-04-07 17:24:59 +09:00
• eebeaba0e0 flake.nix: split off sqlite debugging tools into separate devshell oysteikt 2026-04-06 10:21:11 +09:00
• 7bacfc39a8 WIP oysteikt 2026-04-06 12:55:40 +09:00
• c74a5f5cb6 flake.nix: build sqlite with ICU extension oysteikt 2026-04-06 10:21:59 +09:00
• 4fbed59143 flake.nix: split off sqlite debugging tools into separate devshell oysteikt 2026-04-06 10:21:11 +09:00
• 61ac226fc3 word_search_result: add getter for unusual kanji flag oysteikt 2026-04-02 15:47:22 +09:00
• ede57a7a00 docs: init oysteikt 2026-04-01 16:48:40 +09:00
• 2ad1e038f1 tanos-jlpt: remove flatten from xml stream oysteikt 2026-04-01 16:04:41 +09:00
• f40825de65 jmdict: skip inserting duplicate xrefs oysteikt 2026-04-01 16:03:56 +09:00
• 5aa068eaec flake.nix: add sqldiff to devshell oysteikt 2026-04-01 15:27:25 +09:00
• 170c3a853e flake.lock: bump, pubspec.lock: update inputs oysteikt 2026-03-26 22:18:10 +09:00
• df8b204d3c WIP: search/word_search: do a bit of performance optimization on result regrouping word-regrouping-optimization oysteikt 2026-03-04 17:49:49 +09:00
• c70838d1bf Add a basic benchmark oysteikt 2026-03-04 19:00:57 +09:00
• 0f7854a4fc migrations: add version tables for all data sources oysteikt 2026-03-03 12:59:58 +09:00
• a86f857553 util/romaji_transliteration: add functions to generate transliteration spans oysteikt 2026-03-02 18:21:06 +09:00
• d14e3909d4 search/filter_kanji: keep order when deduplicating oysteikt 2026-03-02 17:37:45 +09:00
• bb44bf786a tests: move const_data tests to test/const_data oysteikt 2026-03-02 17:16:14 +09:00
• ad3343a01e README: add link to coverage oysteikt 2026-03-02 15:02:36 +09:00
• 16d72e94ba WIP: .gitea/workflows: generate coverage oysteikt 2026-03-02 14:34:08 +09:00
• b070a1fd31 .gitea/workflows: merge build and test pipeline oysteikt 2026-03-02 14:31:59 +09:00
• dcf5c8ebe7 lemmatizer: implement equality for AllomorphPattern/LemmatizationRule oysteikt 2026-03-02 11:47:46 +09:00
• 1f8bc8bac5 lemmatizer: let LemmatizationRule.validChildClasses be a set oysteikt 2026-03-02 11:46:40 +09:00
• ab28b5788b search/word_search: fix english queries without pageSize/offset oysteikt 2026-03-02 11:24:49 +09:00
• dd7b2917dc flake.nix: add lcov to devshell oysteikt 2026-03-02 10:50:24 +09:00
• 74798c77b5 flake.nix: add libsqlite to LD_LIBRARY_PATH in devshell oysteikt 2026-03-02 10:44:37 +09:00
• 63a4caa626 lemmatizer/rules/ichidan: add informal conditionals oysteikt 2026-03-02 10:34:50 +09:00
• 374be5ca6b lemmatizer: add some basic tests oysteikt 2026-03-02 09:31:36 +09:00
• 4a6fd41f31 lemmatizer: misc small improvements oysteikt 2026-03-02 09:30:01 +09:00
• c06fff9e5a lemmatizer/rules: name all rules as separate static variables oysteikt 2026-03-01 11:34:53 +09:00
• 1d9928ade1 search/kanji: split queries into separate functions oysteikt 2026-02-28 18:57:57 +09:00
• 1a3b04be00 word_search_result: add romanization getters oysteikt 2026-02-28 18:46:13 +09:00
• c0c6f97a01 search/word_search: fix casing of SearchMode variants oysteikt 2026-02-28 18:27:13 +09:00
• a954188d5d Fix a few lints oysteikt 2026-02-28 18:25:37 +09:00
• 5b86d6eb67 README: add textual overview of the word search procedure oysteikt 2026-02-28 14:52:22 +09:00
• 72f31e974b dart format oysteikt 2026-02-28 14:37:17 +09:00
• e824dc0a22 search/word_search: split data queries into functions oysteikt 2026-02-28 14:36:14 +09:00
• f5bca61839 flake.lock: bump v0.6.0 oysteikt 2026-02-25 16:28:18 +09:00
• 056aaaa0ce tests/search_match_inference: add more cases oysteikt 2026-02-25 12:42:38 +09:00
• a696ed9733 Generate matchspans for word search results oysteikt 2026-02-24 16:54:37 +09:00
• 00b963bfed .gitea/workflows/test: init oysteikt 2026-02-24 20:39:35 +09:00
• 4376012f18 pubspec.lock: update deps oysteikt 2026-02-24 18:44:20 +09:00
• 8ae1d882a0 Add TODO for word matching oysteikt 2026-02-24 15:21:03 +09:00
• 81db60ccf7 Add some docstrings oysteikt 2026-02-24 15:13:33 +09:00
• f57cc68ef3 search/radicals: deduplicate input radicals before search oysteikt 2026-02-24 15:08:19 +09:00
• 48f50628a1 Create empty() factory for word search results oysteikt 2026-02-23 13:01:57 +09:00
• 1783338b2a nix/database_tool: fix building oysteikt 2026-02-21 00:49:53 +09:00
• e92e99922b {flake.lock,pubspec.*}: bump oysteikt 2026-02-21 00:49:24 +09:00
• 05b56466e7 tanos-jlpt: fix breaking changes for csv parser oysteikt 2026-02-21 00:46:24 +09:00
• 33016ca751 flake.nix: comment out sqlint, currently broken due to dep build failure oysteikt 2026-02-09 14:45:19 +09:00
• 98d92d370d {flake.lock,pubspec.lock}: bump, source libsqlite via hooks oysteikt 2026-02-09 14:44:14 +09:00
• 5252936bdc flake.nix: filter more files from src oysteikt 2026-02-09 14:40:53 +09:00
• ac0cb14bbe flake.lock: bump, pubspec.lock: update inputs v0.5.0 oysteikt 2025-12-19 08:34:58 +09:00
• 49a86f60ea .gitea/workflows: upload db as artifact oysteikt 2025-12-19 08:27:46 +09:00
• 9472156feb .gitea/workflows: update actions/checkout: v3 -> v6 oysteikt 2025-12-08 18:46:26 +09:00
• 4fbdba604e .gitea/workflows: run on debian-latest oysteikt 2025-12-08 18:46:21 +09:00
• 0cdfa2015e .gitea/workflows: add workflow for building database oysteikt 2025-11-13 16:33:51 +09:00
• a9ca9b08a5 flake.lock: bump, pubspec.lock: update inputs oysteikt 2025-11-13 16:13:51 +09:00
• 45e8181041 search/kanji: don't transliterate onyomi to katakana oysteikt 2025-07-30 01:37:26 +02:00
• 0d3ebc97f5 flake.lock: bump mugiten-v0.4.0 oysteikt 2025-07-17 00:21:48 +02:00
• bb68319527 treewide: add and apply a bunch of lints oysteikt 2025-07-17 00:21:36 +02:00
• 2803db9c12 bin/query-word: fix default pagination oysteikt 2025-07-16 18:32:47 +02:00
• 93b76ed660 word_search: include data for cross references oysteikt 2025-07-16 18:32:28 +02:00
• 29a3a6aafb treewide: dart format oysteikt 2025-07-16 15:23:04 +02:00
• 3a2adf0367 pubspec.{yaml,lock}: update deps oysteikt 2025-07-15 21:32:42 +02:00