![Imdb database dumps](https://kumkoniak.com/96.jpg)
You can find similar indices for the RDBMS that you are using. In PostgreSQL, depending on the column data type, this kind of index is called varchar_pattern_ops or bpchar_pattern_ops or text_pattern_ops. For example when the user wants to filter by movie name and they type the first few letters of the movie, all the movies that start with those letters should be shown to the user so they can select from the list.
- One for filtering the data when a filter has been applied.
- Of course the dashboard loading speed depends on the computing power of the DB as well. Make sure to index the tables as well, because the size of the data is fairly large (one of the tables has ~500K rows and the other one ~400K rows). One for top-rated movies/series ( link ) and one for various information about a given series ( link ). In the sequel we go over the steps required to go from data dump files to a fully operational online dashboard.īefore we start, let’s take a look at the final product.
At first I thought I need to scrape the data off their website because they don’t provide an API for their website, but then I found out that there are daily data dumps available for download. These limitations persuaded me to create my own lists out of IMDB data to be able to easily find top-rated movies/series to watch. The minimum number of votes is important because sometimes poor movies/series have a high rating due to a small number of votes with high points.
Also you cannot apply a minimum number of votes to the suggested lists. For example if you want to filter by year and find the best series in the last two years, you cannot do that. Although there are lists of top-rated movies and series available in IMDB website which are helpful for finding good movies or series to watch, but the filters available for these lists are limited. I find the IMDB ratings pretty accurate most of the time, and if somebody suggests a movie or series to watch, I usually check its IMDB rating to see whether it’s worth the time.