Hybrid Intelligence: Marrying Deterministic Code with LLMs for Robust Software Development

Balancing Rule-Driven Precision with Generative Flexibility   Executive Summary Traditional software, built solely on deterministic, rule-based logic, guarantees reliability and predictability but often struggles to adapt. Large language models (LLMs), by contrast, offer flexibility and cognitive capabilities but can be unpredictable. A hybrid approach — combining deterministic code with LLM-driven reasoning — yields systems that […]

Using Core Concepts of Computational Linguistics with RAG

A super colorful infographic ChatGPT created for this article. How linguistic fundamentals shape the design and performance of retrieval-augmented generation systems In a previous article, I discussed the core concepts of computational linguistics that every language model, big and small, needs to have. This article will discuss the core components of retrieval-augmented generation (RAG) models, show […]

Core Concepts for Small Language Models

Foundational Computational Linguistics Concepts and how they relate to Language Models LLMs are all the rage, and to use them effectively as engineers and users of any kind we could benefit from thinking about them in the context of some core Natural Language Processing (NLP) concepts. At New Math Data, we’ve been building a lot […]

Streamlining Talent Acquisition with HireBot, your AI Powered Recruiter

Introduction HireBot is a chatbot designed to streamline the initial screening process of candidate resumes and profiles for recruiters and hiring managers. It leverages natural language processing to interpret resumes, allowing users to query candidate information through a natural language interface. The primary issue HireBot addresses is the time-consuming nature of manual resume screening, reducing […]

LLMs and chatbots: a brief update

Generally and historically, data engineering, analytics, and science efforts focused on progressing from data to knowledge/wisdom. The emergence of LLMs allows for the decomposition of wisdom/knowledge back down to data. This can enable novel discovery, integrate with information systems, and drive automated processes. GenAI Categories Generation: Use bedrock models to create code, text, or images […]

Use AWS Bedrock language models with a Slack-powered chatbot

co-authors: Meghana Venkataswamy, Sean Cahill, Salman Ahmed Mian Architecture What is a Foundational Model? How Do we customize the FM to our Data and needs? Our /hr-bot uses RAG Technique FAISS (Facebook AI Similarity Search) What is AWS Kendra LangChain AWS Bedrock Slack integration Terraform Challenges and opportunities Navigating policy and rules in a large […]

Harnessing the Power of Large Language Models for Knowledge Graph Creation

· The role of large language models in creating knowledge graphs from unstructured data.· Comparison of Top Models· Storage Platforms for Knowledge Graphs· Practical Example: Knowledge Graph from Wikipedia Text· Best Practices and Tips for Using Large Language Models in Knowledge Graph Creation· Conclusion In the vast realm of data, the ability to meaningfully connect […]