Commit Graph

Select branches

Hide Pull Requests

parallel

Mono Color

• 7e1f45f466 Chore: removing old files and some experiments parallel Richard Wong 2024-10-06 23:53:57 +0900
• 0762c02b31 Feat: implemented attention layer in equinox Richard Wong 2024-10-06 23:52:42 +0900
• a817fe16cc Feat: increased learning rate for effective large batch size learning Richard Wong 2024-09-22 22:28:41 +0900
• aca80720c8 Feat: t5_jax_simple_parallel implements a working example of fsdp Richard Wong 2024-09-20 23:42:51 +0900
• 429e1742ab Feat: flax pjit example Richard Wong 2024-09-16 12:19:07 +0900
• ad5cf7735f Feat: fsdp demo Refactor: pulling dataloader code into dataload.py Richard Wong 2024-09-15 22:41:00 +0900
• 005a1a5735 Feat: learn flax Richard Wong 2024-09-14 14:13:38 +0900
• d2dd72227f Feat: introduced efficient train data dtype, jit train step, bfloat16 mat mul Richard Wong 2024-09-14 02:02:45 +0900
• edd9c3551f Feat: implement working prediction Richard Wong 2024-09-12 22:57:19 +0900
• f523560141 Feat: jax implementation of t5 training and prediction Richard Wong 2024-09-11 08:17:02 +0900