S3 Custom Lifecycles: An AWS Glue solution to incorporate read operations into S3 Lifecycles
Introduction S3 Lifecycles provide a fantastic way to manage the lifetimes of S3 Objects. Working in AWS and in bigger organizations, you will inevitably have objects lingering (often in standard storage), costing you money. Lifecycle rules offer an easy way to trim some fat, which can both help you save money and exist in a […]
An In-Depth Overview of Electrical Generation, Transmission, Distribution, and Future Innovations
High level conceptual picture of Generation, Transmission and Distribution Systems Electricity powers modern civilization, enabling technological advancements and industrial growth. Its journey from generation to end-users involves intricate systems of infrastructure and management. This whitepaper explores the critical stages of this journey — generation, transmission, and distribution — while examining the transformative potential of Distributed […]
Needle in a Haystack: A Rag Architecture and Use Case for Biotech
AI Acceleration with Pluton Bioscience If you’ve ever had to navigate a complex research process, you likely understand the challenges of sifting through vast amounts of information to find specific, valuable insights. Our partners at Pluton Biosciences have faced similar hurdles in their work. These research processes, while essential for gaining critical knowledge, can be […]
What’s New in AWS: Highlighting Key September 2024 Releases
Introduction AWS continues to lead the cloud industry with a series of powerful updates designed to enhance efficiency, scalability, and creativity. From groundbreaking improvements in storage management to cutting-edge AI tools, the latest releases showcase AWS’s commitment to evolving business needs. In this post, we’ll explore key updates, including Amazon S3’s new conditional writes, advanced […]
How To Statically Host a Wiki
A wiki is a great way to keep track of organizational info. But maybe you want to track some personal notes and you don’t want to pay for a Confluence license. This blog post will show you how you can host a wiki with a custom domain, using AWS’s world-wide network to deliver your content […]
Logging: The Unsung Hero of System Reliability
The Critical Role of Logs in Diagnosing and Resolving Issues on AWS and on-prem Introduction Recently, I was enlisted to assist an eCommerce aggregator whose product listing service went down. Although the front end handled the issue gracefully, no sales were occurring across the dozens of customer web stores. During the investigation, we discovered that […]
AWS First Look: Key Updates for August 2024
Explore updates to Bedrock FedRAMP, Meta Llama 3.1, SRT Support, and DMS Introduction In the ever-evolving landscape of cloud computing, AWS continues to innovate, delivering new features and updates that enhance the capabilities and reliability of their services. This month brings a host of exciting developments across various AWS offerings. From improved data replication for […]
Augment Your Retrieval: LLMs with Python LangChain and AWS OpenSearch VectorSearch database
Introduction In this blog post we will introduce vector databases and some of the algorithms used for indexing and show examples of how to work with AWS OpenSearch vector database using python and LangChain library. Vector databases A vector database is a type of database that stores high-dimensional vectors for fast retrieval and similarity search. […]
Data Quality Monitoring in AWS SageMaker
First things first, what is data quality monitoring? Data quality monitoring for machine learning can generally be thought of from two perspectives. One perspective is that of traditional data-engineering. This type of monitoring is concerned with the “physical” characteristics of the data and ensuring they are what you expect them to be. It involves criteria […]
Accurate by Design: Advanced Data Quality on AWS
Introduction Data pipelines in AWS orchestrate the movement and transformation of data across various AWS services. The core objective of these pipelines is to enable efficient data processing, analysis, and storage, ensuring that data is available where and when it is needed. Maintaining high data quality throughout this process is critical; it ensures reliability, accuracy, […]