Dec 24, 2021Context Matters in Data-Centric NLPIn model-centric approaches to AI, you accept the data you’re given and focus on iteratively improving your model. In data-centric AI, however, you focus on improving your data instead. One important aspect: the context your data comes from, and whether that’s captured by your features and labels… This article (cross-posted…AI6 min readAI6 min read
Dec 15, 2021Evaluating Language Models: An Introduction to Perplexity in NLPNew, state-of-the-art language models like DeepMind’s Gopher, Microsoft’s Megatron, and OpenAI’s GPT-3 are driving a wave of innovation in NLP. How do you measure the performance of these language models to see how good they are? In a previous post, we gave an overview of different language model evaluation metrics…Artificial Intelligence9 min readArtificial Intelligence9 min read
Dec 15, 2021Inter-Annotator Agreement: An Introduction to Cohen’s Kappa Statistic(This is a crosspost from the official Surge AI blog. If you need help with data labeling and NLP, say hello!) Imagine you’re a Harvard professor teaching English 101. You’re tired of grading homework and want to get back to your research, so you decide to build an NLP model…Machine Learning6 min readMachine Learning6 min read
Nov 27, 2021The Dangers of Context-Insensitivity in NLPWow. This shit is sick! Is that an insult or a compliment? Let’s try another: Wow. These kids can dance. This shit is sick! What about now? I can’t believe these kids support sweatshops. This shit is sick! Language is tricky and rich with nuance: “sick” can mean 🤩, or…Data Science6 min readData Science6 min read
Nov 14, 2021A Cartoon Guide to Language Models in NLP (Part 1: Intuition)(This is a crosspost from the official Surge AI blog. If you need help with data labeling and NLP, say hello!) Introduction Language models are a core component of NLP systems, from machine translation to speech recognition. Intuitively, you can think of language models as answering: “How English is this phrase?” …Artificial Intelligence8 min readArtificial Intelligence8 min read
Oct 28, 2020Introducing Surge AI: ⚡ High-Quality Data Labeling for NLP ⚡In theory, AI has blown past our wildest dreams; in practice, Siri can’t even tell us the weather. The problem? Creating high-quality datasets to train and measure our models is still incredibly difficult. We should be able to gather 20,000 labels for training a Reddit classifier in a single day…Machine Learning6 min readMachine Learning6 min read
