Analyzing and comparing 7 ways of deduplicating rows in a BigQuery table. — TL;DR: Use the QUALIFY clause and go to the conclusion. In this short article, we will dive into some of the different ways to deduplicate rows in a BigQuery table. Summary Introduction Replicability Method 1: Deleting rows in-place Method 2: Selecting distinct Method 3: Grouping by all keys Technical or functional deduplication? Method 4: Grouping by primary…

Deep Dive into DNNs, CNNs, and RNNs Dropout Methods for Regularization, Monte Carlo Uncertainty, and Model Compression — Motivations One of the major challenges when training a model in (Deep) Machine Learning is co-adaptation. This means that the neurons are very dependent on each other. They influence each other considerably and are not independent enough regarding their inputs. It is also common to find cases where some neurons have…

Learn PSO algorithm as a bedtime story with GIFs and python code — Introduction Particle swarm optimization (PSO) has been successfully applied in many research and application areas. For my part, I really enjoyed the application of this algorithm in the article by G. Sermpinis [1] on foreign exchange rate forecasting. It is demonstrated that PSO can have better results in a…

A visual and mathematical explanation of the 2D convolution layer and its arguments — Introduction Deep Learning’s libraries and platforms such as Tensorflow, Keras, Pytorch, Caffe or Theano help us in our daily lives so that every day new applications make us think “Wow!”. We all have our favorite framework, but what they all have in common is that they make things easy for us…

You are not a writer and you are confused about how to start writing an article that is meaningful to you? My method should help you to write your first awesome article. — I love my work, but most of all, I love when I am able to share it. I suppose you are just like me. But each time I start an article, I have no idea where to start, I am afraid of not being legitimate to talk about a subject…

In this tutorial you are going to deploy a simple Cloud Function triggered by a Cloud Storage event with Terraform — Cloud Functions are scalable “pay-as-you-go” Functions as a Service (FaaS) from Google Cloud Platform (GCP) to run your code with zero server management. Cloud Functions can be written in Node.js, Python, Go, Java, .NET, Ruby, and PHP programming languages. For the sake of readability, this tutorial will contain a Cloud…

Visualization, description and python GitHub of benchmark optimization functions. — Motivations If you only are here for eye pleasure you can go to the Benchmark part. 😜 I was looking for a benchmark of test functions to challenge a single objective optimization. I found two great websites with MATLAB and R implementations you can find on the sources. Yet I wanted…

Smooth python codes to augment your image datasets by yourself. — Whether we are enjoying Keras or Pytorch we have access to wonderful libraries to efficiently enhance our images. But what about those special cases where: Our dataset does not have a trivial structure (3 input images and 1–2 segmented outputs as an example). We want total freedom and transparency in…

Everything we need to know about Detection and Prevention of Overfitting and Underfitting in Machine Learning and Deep Learning — Every week, a bunch of flowers grows in my garden. You can think of it as a dataset. It was a good way to playfully introduce my child to complex concepts. In this article we will highlight through this flowery garden: the importance of understanding your dataset. overfitting and underfitting