Items tagged anthropic in Oct, 2023
Filters: Year: 2023 × Month: Oct × anthropic × Sorted by date
Claude was trained on data up until December 2022, but may know some events into early 2023.
— How up-to-date is Claude's training data? # 9th October 2023, 1:25 am
Decomposing Language Models Into Understandable Components. Anthropic appear to have made a major breakthrough with respect to the interpretability of Large Language Models:
“[...] we outline evidence that there are better units of analysis than individual neurons, and we have built machinery that lets us find these units in small transformer models. These units, called features, correspond to patterns (linear combinations) of neuron activations. This provides a path to breaking down complex neural networks into parts we can understand” # 8th October 2023, 3:43 pm