Increased levels of customization and particularization of every capability have made their way into all forms of business and production. The supply chain has not been able to stay out of this domain of reorganization, and as a result, supply chain segmentation is a hot topic.
A digital twin is a highly detailed digital replica of any system that uses comprehensive data to emulate the working of the system at all times. Therefore, a supply chain digital twin is a simulation model of a supply chain. You feed the model real-time data from all sources and systems of the organizations that can exactly work out the effects of macro and micro-changes on the system using advanced analytics and learning models.
In our ongoing series, the AIO Data Science teams publish tutorials that go along with AIO on GitHub. Today, aioneer Maryam introduces read_and_write. This function is necessary because often, CSV files provided by clients contain bad_lines. These are lines with too many fields, like, for instance, too many commas. As a result, these CSV files cannot be read by Qlick, so they need to be cleaned. Doing this one by one would be very time-consuming. Secondly, sometimes it is necessary to combine data files if we receive data in several files or sheets. These need to be concatenated. It would be great to be able to do this in a simple function. In the tutorial, Maryam shows you how to do this!
At aioneers, we create a lot of dashboards and do lots of machine learning tasks. Some of those analyses are done regularly. To deliver these dashboards and machine learning, we need to do a lot of data transformation, like cleaning data and joining tables. To automate data transformation, we use Databricks clusters to run Python and, sometimes, R scripts. Databricks allows us to automatically run data transformation scripts on schedule, but it is missing one essential feature: email notification on how the data was loaded.
In today's tutorial, Sebastian shows you how to use vault_get_secret, the function we have released on our GitHub page last week. vault_get_secret helps you extract keys from the Azure key vault.
The key vault is based on three pillars: key management, secret management and certificate management. We mainly use it for the secret management, where we store tokens, passwords, API keys and so on. Since we need to access these, we wrote a function called vault_get_secret that helps us no longer store the secrets in our code, but rather access them through the function. This is a more secure way of working, and we have to worry less about who has access to the code.
AIO on GitHub is our open source project to support the supply chain community with data science tools. Bit by bit, we are releasing content and showing you how to use it. I have created a hands-on tutorial showing you how to do an XYZ analysis using our tools.
Today on our blog: watch Titus and Sebastian explain why we started AIO on GitHub, our OpenSource project for the supply chain community.
A comprehensive, forward-looking open-source library of code for supply chain scientists does not exist, which means we are all working from scratch for every project. We are taking old scripts, copying them, and adapting them for every new project.