Introduction to GraphQL and AppSync
Core Concepts and Value Propositions In the ever-evolving landscape of web development, efficient data fetching and manipulation have become paramount concerns. Traditional REST APIs, while widely used, often struggle with problems like over-fetching or under-fetching data. Enter GraphQL — a query language for APIs that addresses these issues by giving clients the power to request […]
Accessibility in Data Visualization: A focus on accessibility can lead to more understandable and impactful visualizations for all users
Data visualization is one of the most powerful ways to communicate quantitative and geospatial information. Whether we’re describing the prevalence of themes from user interviews, highlighting trends in sales forecasts, or illustrating the distribution of community health metrics, the ability to transform raw numbers into compelling visuals that communicate concepts is invaluable. Yet, as demand […]
The Art of Data Engineering: Applying Sun Tzu’s Principles
How Ancient Wisdom Can Transform Modern Data Practices Sun Tzu’s “The Art of War” offers timeless wisdom that transcends the battlefield, providing insights applicable to various domains, including data engineering. In this field, success is not merely about coming up with innovative ideas or implementing initial solutions. True success is measured by how effectively these […]
The Winning Mindset
Embracing Total Commitment Introduction Success in both engineering and consulting is deeply tied to the mindset of total commitment and profound engagement. This philosophy, inspired by ancient wisdom and modern insights, suggests that those who invest fully in their work achieve the greatest results. Caring more about each project and client leads to higher quality […]
Harnessing the Power of PySpark in DataBricks Delta Live Tables
Explore the integration of PySpark with DataBricks Delta Live Tables Introduction Welcome to our exploration of how PySpark integrates with Databricks Delta Live Tables, a powerful combination for managing big data workflows with enhanced reliability and integrity. This post is designed for data engineers and scientists who are looking to leverage the capabilities of Jupyter […]
Cultivating a Data-Driven Culture: Leadership Strategies for Success
The Imperative of a Data-Driven Culture in Modern Organizations In today’s rapidly evolving business landscape, the imperative of fostering a data-driven culture within organizations cannot be overstated. As markets become increasingly competitive and the volume of data available for business operations expands, the ability to effectively harness and utilize this data stands as a critical […]
Developing Future Leaders in Cloud Data Engineering
Exploring the Path to Leadership in the Evolving Field of Cloud Data Engineering Introduction The field of cloud data engineering is rapidly evolving, driven by the relentless pace of technological advancements and the increasing reliance on data-driven decision-making. As organizations continue to migrate their operations and data storage to cloud platforms, the demand for skilled […]
Turbocharge your functional tests with LocalStack for AWS
A deep dive into functional testing for AWS development Introduction In our exploration of advanced testing techniques for AWS development, we’ve delved into powerful tools like moto for unit testing and pytest.mark.parametrize for enhancing test coverage and efficiency. Building on this foundation, we turn our focus to a pivotal tool that bridges the gap between […]
Data Modeling for Developers
An Introduction to Data Modeling and Why it Matters for Development Teams Data modeling is a critical yet often underrated skill in technology development and within development teams. This article aims to teach you the basics of it and why it is important. This article will introduce you to the concept of a data model, […]
Data Engineering Methodology: From requirements to hand-off
Introduction Joining or starting data projects in large enterprise environments with many stakeholders can be stressful, not to mention a technical implementation nightmare. When the primary stakeholders can’t (or won’t) give the project team clear requirements, the onus falls to the technical implementation team to create order from the chaos and organize the delivery team […]
