What makes it the de-facto multi-class classifier loss function

There is much to learn and grasp to ace that important Data Science/Machine Learning interview. This article is part of a series of articles that try to make the preparation process easier and less daunting by introducing structure, use visual explanations, and keeping things relevant.

Starry night in forest
Starry night in forest
Photo from Pixabay

Motivation

The proper choice of loss functions is essential to train your machine learning models successfully. Thus questions about them are often brought up by the recruiters during the interview process. Questions may come from multiple fronts and angles, yet as long as you grasp the core concept, you will find that they won’t be much…


Why Deep Learning is so powerful yet so simple in its core

Photo by Kristine Tumanyan on Unsplash

So you’ve heard about AI, heard about the amazing things a well-trained Machine Learning model, especially Deep Learning model can do. In some tasks, it even surpasses human performance. For example, a computer can now recognize different kinds of objects like cats, dogs, cars better, and an average human with faster speed, all thanks to the recent development of deep learning and neural networks. But what you may not hear about, is at its core, lies a simple theorem, a simple principle that makes all these possible. Enter Universal Approximation Theorem. Once you understand it, deep learning or multi-layer neural…


CTF write up you should read BEFORE starting the room

Photo from tryhackme.com

Series Brief

Cybersecurity has always been something I want to get into or at least apply my data science skills to. Not because of the ‘Mr. Robot’ style Hollywood hacking scene though, not that. Rather, I was drawn into it because it embodied curiosity, hunger for knowledge, problem-solving, and the mentality of always be tinkering things.

Enter TryHackMe, the popular online platform that lets you learn cybersecurity through many short, gamified labs(VMs spun up with certain purpose and configuration). It is quite beginner-friendly too. You don’t have to build your own home lab and deal with those virtual machine configurations. They are…


And you can too!

Blogging desk
Blogging desk
Photo by Carl Heyerdahl on Unsplash

Motivation

I’ve been using Pelican as the framework for my data science blog for a while now. It has worked for me, though there were always some minor glitches that made me feel not settled. It never feels complete and satisfying to me. Here are some of the big ones:

Small community and niche position

Pelican has a much smaller community than Hugo. It has 10.4k stars vs. the 51.4k stars on GitHub. On the Static Site Generator community, Pelican is a niche. People already know Python might want to try it out (like me!), but others with better understanding and…


And How to Still Achieve Success

kinds thinking about math
kinds thinking about math
Image by marker_photography from Pixabal.com

It All Started From My Personal Struggle

To tell you the truth, the fear of not being good enough at math has been hunting me from day one when I started my Machine Learning journey. It first struck me when I tried to apply the chain-rule while doing the back-propagation of neural networks. It took me a good several days before the assignment deadline until I finally figured out how to calculate the gradients. Man, that felt hard! I can almost still taste the bitterness and hardship in my mouth. Little did I know, this probably was the easy part. …


Came across this piece talking about the current #machinelearning status by Mark Saroufim. Some views are a bit controversial but good points nonetheless.

I’ll summarize the key points below: 🧵👇

  1. ML Researchers — Supposed to be risk-taking and less commercial oriented so ground-breaking progress can be made. Rather, ML Researchers found ways to not taking any risk but getting good pay through FANNG, media, YouTube, etc., and SOTA chasing.
  2. Math is overrated in Deep Learning. Matrix multiplication is mostly what you need and auto grad removes the real needs for manual gradient calculation. Be real now.
  3. The empiricism tendency of…


A Thought Experiment

Photo by Joshua Aragon on Unsplash

What is UAT?

What exactly is Universal Approximation Theorem? Well, put in layman’s terms, UAT just means that giving a one hidden layer neural network with enough neurons. It can approximate(or simulate closely) any continuous function within the given input range. It means that a one hidden layer neural network is an ultimate flexible function approximator. Maybe a little too flexible.

A Lesson Learned

Because of the flexibility, Universal Approximation Theorem used to push AI researchers to focus mostly on shallow neural networks, thus in some way hinders the development progress of deep learning. This is interesting. Come to think of it, a ‘shallow and wide’…


Why All Data Scientists Not From Computer Science Background Should Take the Course

MIT 6.00.1x and 2x
MIT 6.00.1x and 2x
Photo by Irvan Smith on Unsplash

…my Journey into Data Science So Far

My Data Science self-education journey has always been a bit upside down. Instead of the usual Math > Computer Science > Language/Framework > Machine Learning > Deep Learning path. I took the other way around. I stumbled into Deep Learning from the fast.ai ‘Practical Deep Learning for Coders’ course first, which greatly boosted my interest and intention to learn more. Later I took the classic ‘Machine Learning’ course by Andrew Ng. (my review on these two courses here.) These are both great courses in their own merits and as I learn more and start doing my own projects, I found…


Data Scientist rejoice! Always have a hard time putting your fine LaTex equations into PowerPoint? Worry no more. Jeremy Howard from fast.ai to the rescue. Check out this great piece…

Michael Li

Playing with numbers and shapes. Pushing features and pixels. Traversing multiple dimensions I sail on. Do I carry a towel you asked? The answer is 42 I smiled.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store