# Finetune GPT2on ATOMIC2020

**URL:** <https://discuss.huggingface.co/t/finetune-gpt2on-atomic2020/7168>\
**Category:** Flax/JAX Projects\
**Created:** [June 23, 2021, 7:45pm UTC](https://discuss.huggingface.co/t/finetune-gpt2on-atomic2020/7168 "2021-06-23T19:45:52Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![LouisCastricato](https://avatars.discourse-cdn.com/v4/letter/l/9de0a6/32.png) [@LouisCastricato](https://discuss.huggingface.co/u/LouisCastricato)\
**Post date:** [June 23, 2021, 7:45pm UTC](https://discuss.huggingface.co/t/finetune-gpt2on-atomic2020/7168/1 "2021-06-23T19:45:52Z")

</div>

Description: We will finetune GPT2-JAX on ATOMIC2020 so that we can generate vertices for knowledge graphs

Model: [GPT2-Large](https://huggingface.co/gpt2-large)

Dataset: [ATOMIC2020](https://github.com/allenai/comet-atomic-2020/tree/f5fe091810539707dfbc962f6a6c04f557575d5b)

Training scripts: Training scripts and data processing scripts will be written as part of the project

Expected result: An adaptable JAX pipeline for training knowledge graph systems.