Resilience for Power Systems

Current and Future Trends with A Look at Recent HILF Events The consumption of energy and its transformation into electricity are essential for societal progress. As the Rockefeller Foundation highlights, electricity is a key driver of economic competitiveness and prosperity more now than in previous centuries. Even developing economies depend heavily on stable, reliable, and […]

Introduction to GraphQL and AppSync

Core Concepts and Value Propositions In the ever-evolving landscape of web development, efficient data fetching and manipulation have become paramount concerns. Traditional REST APIs, while widely used, often struggle with problems like over-fetching or under-fetching data. Enter GraphQL — a query language for APIs that addresses these issues by giving clients the power to request […]

SageMaker Training and Deployment with Custom Images

How and Why to Use Custom SageMaker Images If you have used SageMaker for data science modeling work, you have likely used the AWS-provided images to train your models and possibly deploy them to an endpoint. These provide images for scikit-learn, xgboost and deep-learning among other common frameworks. This article will address an issue we […]

The Problem of Underfitting in Machine Learning

ChatGPT generated image What Underfitting is and How to Test for It and Minimize its Impact Machine learning stands as a pivotal element in contemporary data science, fundamentally altering the landscape of predictive analytics and decision-making across various domains. We have written many articles on machine learning concepts, but this one takes us back to […]

FlyngLlama: Combining Robyn and LlamaIndex for Intelligent Document Analysis

A document-devouring llama with Robyn wings that soars through your data! Performance Optimized Retrieval Augmented Generation Introduction In today’s data-driven environment, organizations are challenged to extract meaningful insights from their vast collections of documents. The ability to quickly locate precise information in sources such as legal contracts, research papers, knowledge bases, and technical documentation is […]

Distribution System Reliability: A Brief Overview of Electrical Grid Reliability and Measuring it Using Reliability Indexes

Introduction Electricity is an essential part of modern life, powering homes, businesses, and industries. A reliable electrical distribution system ensures continuous power supply with minimal interruptions. However, outages occur due to weather events, equipment failures, or operational issues. Measuring and improving power system reliability is key to maintaining a stable and efficient grid. Standard IEEE […]

Accessibility in Data Visualization: A focus on accessibility can lead to more understandable and impactful visualizations for all users

Data visualization is one of the most powerful ways to communicate quantitative and geospatial information. Whether we’re describing the prevalence of themes from user interviews, highlighting trends in sales forecasts, or illustrating the distribution of community health metrics, the ability to transform raw numbers into compelling visuals that communicate concepts is invaluable. Yet, as demand […]

How to: AWS OAM Sink and Link

How and Why to Setup Cross-Account Logging in AWS I recently implemented cross-account logging using AWS Observability Access Manager (OAM) for a comprehensive monitoring application my team and I are building. In this, we are looking to create one UI to understand performance and costs across the products in our domain. When setting up cross-account […]

Indexing at Scale: Real-World Lessons from an Amazon Q Business POC

Introduction In today’s data-driven world, the ability to efficiently index vast amounts of information is a game-changer. During our QBusiness Proof of Concept (POC), we at New Math Data embarked on a journey that tested our strategies for handling hundreds of thousands of documents and gigabytes of data — all while ensuring security and accuracy […]

Computer Vision: Image Generator Networks

ChatGPT Generated Understanding of this Article A Look at the Core Concepts and How T2I has Evolved I am a Machine Learning Engineer by trade and a Computer Vision scientist by education, so any use case where computers are trying to learn the wonderful world outside (machine learning), primarily using visual information (computer vision) gives […]