I wanted a way to automatically run this script and had decided to use AWS Lambda (a serverless platform). Lambda lets you write code which lies dormant until it is triggered (e.g. once per week, or based on an event).
This was my first time using Lambda and, try as I might, I just couldn’t get all the imported libraries to work at the same time. To execute, the code needed the boto3 email client, OAuth for the API call, Pandas for storing results and many sub-dependencies. Ordinarily, installing these packages is fairly trivial, but on Lambda there were extra challenges. Firstly, there are memory limits for uploads, so I needed to zip the libraries and unzip them after being uploaded. Secondly, it turns out that AWS Lambda uses custom linux which can make it trickier to import the correct, cross-compatible libraries. Thirdly, my Mac was behaving weirdly with its virtual environments.
My perfect workflow would have been to automatically email myself the list of videos every week using Lambda. That way I could pick out the videos from the past I wanted to watch the forthcoming week, and I’d never have to visit the YouTube home page again.
You can do the same. Find top, interesting project’s source code and check them out. See how those projects were built, what patterns were used, what techniques the authors managed to use that maybe you didn’t even know existed.
The second video was a slightly rogue one — and not the type of video I was looking for. But I couldn’t think of a simple way to screen out these videos, which were picked up due to an alternative meaning of the search term.
These challenges are something you can do daily. I know it’s hard to always find time for them, but I suggest you make 2 or 3 every weeks. So you can keep your mind always prepared and sharp for confronting new coding problems.
# Controlling the recall by setting ef # ef should always be > k p.set_ef(ef) # If you want to save the graph to a file if save_index_file: p.save_index(save_index_file) return p
Several months ago, OpenAI shared a really interesting new neural network called ‘GPT-3’. I decided to test my video finder with ‘GPT-3’ as a search term and found this video:
We’ll first download a large dataset with 500K rows. Then we’ll convert a text column to an 300d embedding vector by using the pre-trained fasttext sentence vector. Then I’ll train both KNN and HNSW ANN models on different lengths of the input data [1000, 10000, 100000, len(data)] to measure the impact of data size on the speed. Finally, I’ll query K = 10 and 100 nearest neighbors from both models to measure the impact of K on the speed. First, let’s import the necessary packages and models. This will take some time as the fasttext model needs to be downloaded from the internet.
I said I thought about it. You know who it is? It’s me in 10 years. So I turned 25. Ten years later, that same person comes to me and says, “So, are you a hero?” And I was like, “not even close. No, no, no.” She said, “Why?” I said, “Because my hero’s me at 35.” So you see every day, every week, every month and every year of my life, my hero’s always 10 years away. I’m never gonna be my hero. I’m not gonna attain that. I know I’m not, and that’s just fine with me because that keeps me with somebody to keep on chasing.
Trying to improve every, single, day as a developer may seem exhausting. But it’s not actually that hard as I’ve shown you in this article. Always remember that exercise may not show its results as you expect.
You can dare to look into your future and imagine it being free of your current problems. Your problems don’t last forever unless you let them. You will find the answers to why your life fell apart, but they may take some time for you to discover.
Staying on the line of the example given above, I guess that every runner would love to work out or see Usain Bolt in action because they could see a top performer showing his abilities and learn.
Over the last few months, I’ve tried with multiple different search terms based on my interests, such as ‘artificial intelligence’, ‘medical AI’ and ‘Python programming’. Pretty much without fail, there’s been at least one interesting video in the top five that the Video Finder suggests.
- CertsLeads enables you to prepare your certification exams, Get most actual and updated exam questions PDF for passing the certifications exam in first attempt
- Maybe your savings account took a major hit in the pandemic. Or maybe you racked up some holiday debt on your credit cards that youre eager to pay off.
- Budget Ruling Gives Democrats Flexibility on Biden Agenda as Party Mulls Reconciliation Budget Ruling Gives Democrats