Posts
Reproducibility is the corner stone of science
Somewhere between building a model and publishing the results, something gets lost. not the results themselves, those make it into the paper. what gets lost is everything that would allow someone else to arrive at the same place.
This is the reproducibility problem in machine learning, and it is more widespread than most people admit.
In 2016, the journal Nature reported that around 70% of researchers had failed to reproduce another researcher’s results , and 50% had failed to reproduce their own. machine learning is no exception. a study that analyzed 400 papers from top AI conferences found that only 6% shared code, roughly 33% shared test data, and 54% shared nothing more than a pseudocode summary of their algorithm. not the environment. not the hyperparameters. not the exact version of the library that made it work. just a rough sketch of the idea.
And I remember telling one of my closest friends, hey just out of the blue it hit me I turned to him and I said: you now, you are one of those friends if I was really in the shit I Would call you, and his reaction, is he didn’t say thank you, he said, I’d be mad if you didn’t, when you don’t call me and say I’m in the mud, you deny me the opportunity, the honor of setting in mud with you. - Simon Sinek
Early to rise early to bed, makes a man healthy but socially dead
Today I folded the first twenty one years of my life, years I can’t repeat or replay. I thank Allah for blessing me to live this long. Those first 21 years were upheavals.
It’s May 6, and I will be turning 21 in less than a month. I used to document at this time of the year, where I try as much as possible to reflect on the progress made this year, perhaps my learning process.
“They thought I’m one, but I’m many.”
— Bakry