OpenSource Contributions
[Highlights]
- KerasNLP - Add Llama Backbone
- KerasNLP - Port GPTNeoX to KerasCore
- KerasNLP - Adding GPTNeoXBackbone
- KerasNLP - Generic RotaryEmbedding Layer
- Keras - Add rsqrt to ops API
- Keras - Add rms_scaling in LayerNormalization
- FluxML - Adding UNet Model
- Deepchem - Porting CNN from TF ➡️ PyTorch
- Deepchem - Neural ODE tutorial 📚
[All Contributions]
keras-nlp
- Fix RotaryEmbedding import
- Fix Autograph error with perplexity metric
- Fix ModuleNotFoundError keras_nlp.models.xlnet
- Port BeamSampler to core
- Add compute_output_shape to tokenizer
- Refactor RotaryEmbedding and GPTNeoXAttention
- Add GPTNeoXPreprocessor
- Add an XLMRobertaMaskedLM task model
- Speed up default RoBERTa testing roughly 3x
- Adding XXBackboneTPUTests
- Default compilation for Albert, Distilbert, Roberta MaskedLM
- Call super.config() in BartBackbone’s get_config()
- Add API exports for tokenizers documented on keras.io
- Add API exports for metrics documented on keras.io
- Add API exports for samplers documented on keras.io
- Add API exports for models documented on keras.io
- Adding an AlbertMaskedLM task + Fix Projection layer dimension in MaskedLMHead
- Add an add_prefix_space Arg in BytePairTokenizer
- Move from_preset to base tokenizer classes
- Add AlbertClassifier
- Add Llama Backbone
- Port GPTNeoX to KerasCore
- Adding GPTNeoXBackbone
- Generic RotaryEmbedding Layer