Data visualization is one of the most powerful ways to communicate quantitative and geospatial information. Whether we’re describing the prevalence of themes from user interviews, highlighting trends in sales forecasts, or illustrating the distribution of community health metrics, the ability to transform raw numbers into compelling visuals that communicate concepts is invaluable. Yet, as demand […]
How and Why to Setup Cross-Account Logging in AWS I recently implemented cross-account logging using AWS Observability Access Manager (OAM) for a comprehensive monitoring application my team and I are building. In this, we are looking to create one UI to understand performance and costs across the products in our domain. When setting up cross-account […]
Introduction In today’s data-driven world, the ability to efficiently index vast amounts of information is a game-changer. During our QBusiness Proof of Concept (POC), we at New Math Data embarked on a journey that tested our strategies for handling hundreds of thousands of documents and gigabytes of data — all while ensuring security and accuracy at every […]
A Look at the Core Concepts and How T2I has Evolved ChatGPT Generated Understanding of this Article I am a Machine Learning Engineer by trade and a Computer Vision scientist by education, so any use case where computers are trying to learn the wonderful world outside (machine learning), primarily using visual information (computer vision) gives […]
TL;DR Building in the cloud? Make sure your workloads aren’t held together with duct tape and wishful thinking. The AWS Well-Architected Framework helps you design reliable, secure, cost-effective systems by following six key principles: Operational Excellence, Security, Reliability, Performance Efficiency, Cost Optimization, and Sustainability. Use the AWS Well-Architected Tool to review workloads, tailor assessments with […]
Unleashing Creativity Through Decisive Action Introduction In today’s fast-paced and competitive business landscape, the ability to innovate swiftly and effectively is crucial for success. One key principle that separates thriving organizations and individuals from the rest is a “bias for action.” This mindset prioritizes taking decisive, proactive steps over endless deliberation and analysis. A bias […]
In the world of Big Data, choosing the right storage format is critical for the performance, scalability, and the efficiency of analytics and processing tasks. Apache Parquet, Apache ORC, and Apache Arrow are three popular formats commonly used for data storage and processing within the ecosystem. While each of these formats serves a distinct purposes and has unique optimizations, […]
A Deep Dive into an AWS OpenSearch + Bedrock + Chainlit RAG Pipeline Introduction This article explains how to build a question-answering system that processes PDF and Video Text Track (VTT) files, index them in AWS OpenSearch, and serve fast answers to users. It uses AWS Bedrock (Anthropic Claude) for language processing and Chainlit for a chat-based interface; through this, […]
Introduction S3 Lifecycles provide a fantastic way to manage the lifetimes of S3 Objects. Working in AWS and in bigger organizations, you will inevitably have objects lingering (often in standard storage), costing you money. Lifecycle rules offer an easy way to trim some fat, which can both help you save money and exist in a tidier […]
Electricity powers modern civilization, enabling technological advancements and industrial growth. Its journey from generation to end-users involves intricate systems of infrastructure and management. This whitepaper explores the critical stages of this journey — generation, transmission, and distribution — while examining the transformative potential of Distributed Energy Resources (DERs) and Distributed Energy Resource Management Systems (DERMS). […]