|Roberto Treviño Cervantes ae957cd5c2||1 week ago|
|static||1 week ago|
|templates||1 week ago|
|.gitignore||3 months ago|
|COPYING.txt||8 months ago|
|Monad.py||1 week ago|
|README.md||1 month ago|
|README.txt||8 months ago|
|bootstrap.sh||1 week ago|
|build_index.sh||2 months ago|
|count_annoy_index.py||7 months ago|
|count_peers.py||3 months ago|
|create_annoy_index.py||1 week ago|
|forms.py||8 months ago|
|future.py||1 week ago|
|linkreaper.py||2 weeks ago|
|passenger_wsgi.py||8 months ago|
|save_index.sh||2 months ago|
|stoplist.hdf5||8 months ago|
|sw.js||7 months ago|
|tranco_JKGY.csv||1 month ago|
FUTURE is a search engine that improves on traditional methods of search by keyword by instead relying on machine learning techniques to encode words as vectors, and capture their meaning and be able to return more precise matches, all while dropping user tracking as only the query is sufficient to retrieve meaningful data. It was written with Python for backend, using Tensorflow and PyTorch and web technologies for the frontend.
FUTURE IS DISTRIBUTED UNDER THE GNU GPL v3
In order to get FUTURE working, first you will need to install the appropiate tensorflow and pytorch packages for your system. After that, it is only necessary that you run the following commands, which have been tested on Arch Linux, Open SuSe and Ubuntu:
The last command will never finish in a feasible amount of time, as it is building the index. However it can always be paused with CTRL+C and resumed later. Shell scripts to automate tasks are provided and are aptly named.
Pause the crawler with CTRL+C, and execute:
Finally, start the server, and point your browser to 0.0.0.0:3000 with the command below:
Out of the box, FUTURE is designed as a web search engine, which means that running the
./bootstrap.sh script provided will only prepare it to search web pages. However, it is hackable down to the core, therefore, you can open
indexer.py and tinker with it to save other types of data into the LMDB database, or perhaps refer to the
Monad class on the
Monad.py and write the files to handle the creation of the database and the index yourself.
If you were to modify the data that is saved into the database, you may also need to change how it is served in an HTML template, and for that refer to the lines 240-327 of
future.py, where you can adapt the code that manages the database to whatever suits your needs.
For further modifications, feel free to fork the project, but bear in mind the terms of the GPL v3 license.
Below are listed all the projects upon which FUTURE rests.
|BSON Python bindings||Apache 2.0|
|SciKit Learn||BSD 3-Clause|
|LMBD Python bindings||OpenLDAP|
|Source Sans Pro||OFL 1.1|