And Here’s How They’re Going To Do It — I’ve had my Tesla Model 3 for almost a year now and I purchased it with the Full Self-Driving (FSD) optional extra. At the time, this optional extra provided some self-driving features, but the car was far from driving me from A to B without human intervention. …

Machine Learning using only SQL — Machine learning (ML) is a rapidly growing field that is transforming many industries, from finance to healthcare to retail. Amazon Redshift is a popular cloud-based data warehousing platform that offers a range of powerful tools and features for working with large data sets. In this article, I will explore the…

We look at how CDC works with DynamoDB and its potential use cases. — DynamoDB is a popular NoSQL database available in AWS. It is a managed service with minimal setup and pay-as-you-go costing. Developers can quickly create databases that store complex objects with flexible schemas that can mutate over time. DynamoDB is resilient and scalable due to the use of sharding techniques. …

The arguments for and against two approaches to data analytics and their optimal use cases — In 2019, Gartner predicted that “by 2022, more than half of major new business systems will incorporate continuous intelligence that uses real-time context data to improve decisions,” and users have grown to expect real-time data, especially since the rise of social networks. Companies are adopting real-time data for many reasons…

An example architecture and multiple techniques — There are multiple change data capture methods available when using a MySQL or Postgres database. Some of these methods overlap and are very similar regardless of which database technology you are using, others are different. Ultimately, we require a way to specify and detect what has changed and a method…

Methods for keeping two databases in sync — What Is Change Data Capture? Change data capture (CDC) is the process of recognising when data has been changed in a source system so a downstream process or system can action that change. …

Flashy data software isn’t the answer — All modern businesses should be data-savvy. Any business not actively seeking out data points to understand performance and improve will ultimately be superseded by those who are. Data-driven organizations are now 23x more likely to acquire customers, 6x as likely to retain customers and 19x more likely to be profitable. …

Make way for data engineers — Data science has been a hot topic in the data space for a number of years now but starting in 2019, data scientist salaries have shrunk 1.2% year-on-year, mainly due to oversaturation in the market. It has become too popular. The tools and techniques have been abstracted enough now that…

Building an online marketplace to demonstrate the differences — Elasticsearch has long been used for a wide variety of real-time analytics use cases, including log storage and analysis and search applications. The reason it’s so popular is because of how it indexes data so it’s efficient for search. …