AI Code Reviewer: Enhance your GitHub workflow with AI-powered code review. Get intelligent feedback and suggestions on pull requests using OpenAI's GPT-4 API, improving code quality and saving developers time.
Unsplash Image Search Search photos on Unsplash using natural language descriptions. The search is powered by OpenAI's CLIP model and the Unsplash Dataset. "Two dogs playing in the snow" Photos by Richard Burlton, Karl Anderson and Xuecheng Chen on Unsplash. "The word love written on the wall" Photos by Genton Damian , Anna Rozwadowska, Jude Beck on Unsplash. "The feeling when your program finally works" Photos by bruce mars, LOGAN WEAVER, Vasyl Skunziak on Unsplash. "The Syndey Opera House and the
Harbour Bridge at night" Photos by Dalal Nizam and Anna Tremewan on Unsplash. OpenAI's CLIP neural network is able to transform both images and text into the same latent space, where they can be compared using a similarity measure. For this project, all photos from the full Unsplash Dataset (almost 2M photos) were downloaded and processed with CLIP. The pre-computed feature vectors for all images can then be used to find the best match to a natural language search
query. On Google Colab If you just want to play around with different queries jump to the Colab notebook. On your machine Before running any of the code, make sure to install all dependencies: If you want to run all the code yourself open the Jupyter notebooks in the order they are numbered and follow the instructions there: - setup the environment checking out and preparing the CLIP code. - download the photos from the Unsplash dataset - process all photos from the
dataset with CLIP - search for a photo in the dataset using natural language queries - search for a photo using the Unsplash Search API and filter the results using CLIP. NOTE: only the Lite version of the Unsplash Dataset is publicly available. If you want to use the Full version, you will need to apply for (free) access. NOTE: searching for images using the Unsplash Search API doesn't require access to the Unsplash Dataset, but will probably deliver worse results. Acknowledgements
This project was inspired by these projects: Beyond tags and entering the semantic search era on images with OpenAI CLIP by Ramsri Goutham Golla Alph, The Sacred River by Travis Hoppe OpenAI's CLIP Unsplash
Frequently asked questions
How many stars and forks are recorded?
haltakov/natural-language-image-search has 1,045 stars and 103 forks.
What is the repository rank?
haltakov/natural-language-image-search is ranked 11,908.
What language and category are recorded?
haltakov/natural-language-image-search has 1,045 stars, uses Jupyter Notebook and belongs to Applications.
Which repository is closest in rank?
haltakov/natural-language-image-search is compared with IBM/MAX-Image-Resolution-Enhancer, ranked 11,899 with 1,046 stars.
README
Unsplash Image Search
Search photos on Unsplash using natural language descriptions. The search is powered by OpenAI's CLIP model and the Unsplash Dataset.
OpenAI's CLIP neural network is able to transform both images and text into the same latent space, where they can be compared using a similarity measure.
For this project, all photos from the full Unsplash Dataset (almost 2M photos) were downloaded and processed with CLIP.
The pre-computed feature vectors for all images can then be used to find the best match to a natural language search query.
How To Run The Code?
On Google Colab
If you just want to play around with different queries jump to the Colab notebook.
On your machine
Before running any of the code, make sure to install all dependencies:
pip install -r requirements.txt
If you want to run all the code yourself open the Jupyter notebooks in the order they are numbered and follow the instructions there:
01-setup-clip.ipynb - setup the environment checking out and preparing the CLIP code.
02-download-unsplash-dataset.ipynb - download the photos from the Unsplash dataset
03-process-unsplash-dataset.ipynb - process all photos from the dataset with CLIP
04-search-image-dataset.ipynb - search for a photo in the dataset using natural language queries
09-search-image-api.ipynb - search for a photo using the Unsplash Search API and filter the results using CLIP.
NOTE: only the Lite version of the Unsplash Dataset is publicly available. If you want to use the Full version, you will need to apply for (free) access.
NOTE: searching for images using the Unsplash Search API doesn't require access to the Unsplash Dataset, but will probably deliver worse results.
Photos by Richard Burlton, Karl Anderson and Xuecheng Chen on Unsplash.
Photos by Genton Damian , Anna Rozwadowska, Jude Beck on Unsplash.
Photos by bruce mars, LOGAN WEAVER, Vasyl Skunziak on Unsplash.
Photos by Dalal Nizam and Anna Tremewan on Unsplash.