Commit Graph

12 Commits

Author SHA1 Message Date
Richard Wong c5760d127d Feat: added post_processing based on rules
others:
- added basic data analysis to get histograms of text differences
- added new final delivery model
2024-12-18 13:43:56 +09:00
Richard Wong 446ed1429c feat: end-to-end code needed for deployment that includes preprocess,
mapping, post-process (de-duplication)
2024-12-02 14:57:03 +09:00
Richard Wong 737c86bc2e Feat: added de_duplication post-processing method 2024-11-28 11:02:22 +09:00
Richard Wong ff6e11a3c0 Feat: added more classification and mapping variations
Feat: added grid-search for threshold in similarity-classifier
Feat: added more abbreviation rules
2024-11-25 18:15:28 +09:00
Richard Wong 1f3970459f Chore: re-organized train folders to have standardized naming schemes
Feat: introduced BERT-based binary classification
2024-11-20 15:07:47 +09:00
Richard Wong 96e7394c59 Feat: tuned selection_with_pattern to perform better 2024-11-11 21:47:24 +09:00
Richard Wong 7699201cb8 Feat: implement selection for pattern-mapping
Feat: added error analysis for BERT find-back
Feat: added direct mapping with unit
Feat: added BERT for classification using description only
2024-11-11 20:20:43 +09:00
Richard Wong bb3ddfaa2f Feat: include basic ood similarity analysis using bert 2024-11-11 02:18:57 +09:00
Richard Wong 0ad182f2b9 Feat: added classification for all data, including non-mdm, as a
training baseline model
2024-11-01 13:21:12 +09:00
Richard Wong 18e4a5f7df Chore: moved selection to post_process, mapping to test 2024-10-31 16:35:28 +09:00
hhs0625 24829c7abf [TASK] the entier paper work 2024-09-25 08:52:30 +09:00
hhs0625 3d2266cf65 [TASK] init 2024-08-26 19:51:11 +09:00