Figure 1: Representation of the Text2SQL flowAs our world is getting more global and dynamic, businesses are more and more dependent on data for making informed, objective and timely decisions. However, as of now, unleashing the full potential of organisational data is often a privilege of a handful of data scientists and analysts. Most employees don’t master the … [Read more...] about Creating An Information Edge With Conversational Access To Data
Data Science & Engineering
Data Capitalism: Innovation, Extraction, Social Conscience
How to advance social capital in a world increasingly governed by surveillance capitalism?About a year ago, I read Atlas of AI by Kate Crawford, a brilliant analysis of the extractive processes that govern the field of machine learning, from environmental resource allocation to the harvesting of our political fabric to data privacy infringements. This article … [Read more...] about Data Capitalism: Innovation, Extraction, Social Conscience
How I Built An AI Text-to-Art Generator
OverviewThis article is a write-up on how I built Text2Art.com in a week. Text2Art is an AI-powered art generator based on VQGAN+CLIP that can generate all kinds of art such as pixel art, drawing, and painting from just text input. The article follows my thought process from experimenting with VQGAN+CLIP, building a simple UI with Gradio, switching to FastAPI to … [Read more...] about How I Built An AI Text-to-Art Generator
Construct A Biomedical Knowledge Graph With NLP
I have already demonstrated how to create a knowledge graph out of a Wikipedia page. However, since the post got a lot of attention, I’ve decided to explore other domains where using NLP techniques to construct a knowledge graph makes sense. In my opinion, the biomedical field is a prime example where representing the data as a graph makes sense as you are often analyzing … [Read more...] about Construct A Biomedical Knowledge Graph With NLP
Simple Model Stacking, Explained And Automated
An overview of Model StackingIn model stacking, we don’t use one single model to make our predictions — instead, we make predictions with several different models, and then use those predictions as features for a higher-level meta model. It can work especially well with varied types of lower-level learners, all contributing different strengths to the meta model. Model … [Read more...] about Simple Model Stacking, Explained And Automated
Online Experiments Tricks – Variance Reduction
Why do we need variance reduction?When we do online experiments or A/B testing, we need to ensure our test has high statistical power so that we have a high probability to find the experimental effect if it does exist. What are the factors that might affect power? Sample sizes, sampling variance of the experiment metric, significance level alpha, and effect size.The … [Read more...] about Online Experiments Tricks – Variance Reduction
How To Visualize Databases As Network Graphs In Python
At work I recently faced the challenge of having to analyze the data model of an SQL database consisting of more than 500 tables with thousands of relations. At this scale, the built-in visualization function of phpMyAdmin is insufficient for getting a deep understanding of the structure. What I needed was a tool in which I can apply various filters (e.g., table and … [Read more...] about How To Visualize Databases As Network Graphs In Python
A Guide To Knowledge Graphs
Table of ContentsIntroduction- What is a Knowledge Graph (KG)?- Why KG?- How to use KG?KG in practice- Open source KGs- Creating custom KG- KG ontology- Hosting KG (database)- Query facts from KGIntroductionIn this section, we will introduce KG by asking some simple but intuitive questions about KG. In fact, we will cover the what, why, and how of the knowledge … [Read more...] about A Guide To Knowledge Graphs
Practical Guide To Ensemble Learning
Ensemble learning is a technique used in machine learning to combine multiple models into a group model, in other words into an ensemble model. The ensemble model aims to perform better than each model alone or if not, to perform at least as well as the best individual model in the group.In this article, you will learn popular ensemble … [Read more...] about Practical Guide To Ensemble Learning
Hands-on Survival Analysis With Python
Survival analysis is a popular statistical method to investigate the expected duration of time until an event of interest occurs. We can recall it from medicine as patients' survival time analysis, from engineering as reliability analysis or time-to-failure analysis, and from economics as duration analysis.Besides these disciplines, survival analysis can also be used by HR … [Read more...] about Hands-on Survival Analysis With Python