Commit Graph

102 Commits (1795695cc6ebdfd2fdfa18c4741728081509d478)

Author SHA1 Message Date
Ben Busby 1795695cc6
Merge pull request #9 from mendel5/patch-1
fix spelling: Whoole --> Whoogle
2020-05-10 11:04:24 -06:00
Ben Busby 90995d79e4
Merge pull request #13 from Alpha200/improved-dockerfile
Improved Dockerfile
2020-05-10 11:03:11 -06:00
Daniel Sendzik 2daca9a352
Improved Dockerfile 2020-05-10 14:00:22 +02:00
mendel5 3a4a8ce95b
fix spelling: Whoole --> Whoogle 2020-05-10 10:53:19 +02:00
Ben Busby df6c36cd24
Update app.json
Fixed image and repo link
2020-05-09 18:38:19 -06:00
Ben Busby 3d38b80833
Small update to readme
Clarified the heroku app naming section
2020-05-08 13:19:51 -06:00
Ben Busby 1ae946eab7
Update README.md 2020-05-08 13:15:17 -06:00
Ben Busby 68da3cd4cd Updated readme with pip instructions, fixed travis badge 2020-05-08 10:38:01 -06:00
Ben Busby d1a268551e
Update README.md 2020-05-06 19:08:25 -06:00
Ben Busby 130ac4532e Refactored handling of user config
Now implemented as a flask global variable reads from the same json file
as before, but doesn't crash if it does not find an existing file.

Removed user config creation from run script
2020-05-06 18:39:12 -06:00
Ben Busby d316fd77c6 Updated setup and routes for pipx compatibility 2020-05-06 18:13:02 -06:00
Ben Busby 9ca74397b4 Adding setup for pip packaging 2020-05-06 17:24:18 -06:00
Ben Busby d01f56ea03 Removed referrer from links, refacored routes
Added <meta name="referrer" content="no-referrer"> to all whoogle
templates

Refactored search route to use conditionally use either request.args or
request.form, depending on rest call (get vs post respectively)
2020-05-05 18:28:43 -06:00
Ben Busby ab317fa0d0
Update README.md
Replaced img header with regular text header
2020-05-04 18:06:38 -06:00
Ben Busby 29a13d0e6e
Update README.md
Fixed separator formatting
2020-05-04 18:03:11 -06:00
Ben Busby 708769f682 Minor styling refactor, updated app name 2020-05-04 18:00:43 -06:00
Ben Busby 0300eab6df Updated formatting and setup instructions
Switched encoding from utf-8 to unicode-escape in an effort to support multiple
languages besides English.

Updated image results page formatting to fix bad image links (added TODO
for adding full res image link for each image result).

Updated README to include libcurl and libssl install instructions for
manual setup.
2020-05-03 19:32:47 -06:00
Ben Busby 39c475af21 Using urlencode "doseq" option for url args 2020-04-29 20:31:03 -06:00
Ben Busby 3e404cb524 Restructured valid params checking, added empty query redirect 2020-04-29 18:53:58 -06:00
Ben Busby c30f21f950 Minor conditional fix in filter 2020-04-29 14:46:00 -06:00
Ben Busby b83f14be26 Fixed image href filter
Needed to be checking against img attrs, not just the img object itself
2020-04-29 11:18:07 -06:00
Ben Busby 6d38abd1b4 Removed debug from opensearch template 2020-04-29 10:12:49 -06:00
Ben Busby dcd93d4869 Fixed filter params, updated search button text 2020-04-29 10:03:34 -06:00
Ben Busby 5fe308956b Cleaned up filter class, updated js config tool 2020-04-29 09:46:18 -06:00
Ben Busby 0a3da5cea4 Updated js controller and config api route
Controller was refactored to be a bit less monolithic.

Config route was updated to accept an html form data POST rather than
just a json object.
2020-04-28 20:50:12 -06:00
Ben Busby 1cbe394e6f Updated tests, fixed a few bugs
Added opensearch routes test and individual tests for searching via GET
and POST separately.

Fixed incorrect assignment in gen_query.
2020-04-28 18:59:33 -06:00
Ben Busby 0c0ebb8917 Added POST search, encrypted query strings, refactoring
The implementation of POST search support comes with a few benefits. The
most apparent is the avoidance of search queries appearing in web server
logs -- instead of the prior GET approach (i.e.
/search?q=my+search+query), using POST requests with the query stored in
the request body creates logs that simply appear as "/search".

Since a lot of relative links are generated in the results page, I came
up with a way to generate a unique key at run time that is used to
encrypt any query strings before sending to the user. This benefits both
regular text queries as well as fetching of image links and means that
web logs will only show an encrypted string where a link or query
string might slip through.

Unfortunately, GET search requests still need to be supported, as it
doesn't seem that Firefox (on iOS) supports loading search engines by
their opensearch.xml file, but instead relies on manual entry of a
search query string. Once this is updated, I'll probably remove GET
request search support.
2020-04-28 18:19:34 -06:00
Ben Busby 74b0d30306 Merge branch 'master' of github.com:benbusby/shoogle 2020-04-27 20:23:30 -06:00
Ben Busby 4180aedd87 Added image proxying, refactored filter class
Images were previously directly fetched from google search results,
which was a potential privacy hazard. All image sources are now modified
to be passed through shoogle's routing first, which will then fetch raw
image data and pass it through to the user.

Filter class was refactored to split the primary clean method into
smaller, more manageable submethods.
2020-04-27 20:21:36 -06:00
Ben Busby 5d6256662f
Update README.md
Fixed typo in location based searching
2020-04-27 11:12:40 -06:00
Ben Busby b0e6167733 Improved bad url arg filtering 2020-04-26 18:48:40 -06:00
Ben Busby dd077954bf Fixed search results test
For datetime spans in time-filtered search results, anything less than 7
characters or more than 15 can be guaranteed to not be properly
formatted dates (either "mm dd yyyy" or "xx days/months/weeks ago")
2020-04-26 18:11:02 -06:00
Ben Busby 36ce44ae6a
Update README.md 2020-04-26 18:00:29 -06:00
Ben Busby e42d754229 Merge branch 'master' of github.com:benbusby/shoogle 2020-04-25 11:34:20 -06:00
Ben Busby 3bc58b64be Small update to filter class
The image results page seems to have different formatting from non-image
results pages. Should probably revisit this at some point and try to
style the image results page to be more in line with other result types.
2020-04-25 11:32:43 -06:00
Ben Busby fe0f17588a
Update README.md
Updated "Setup" section to clarify that docker setup is unnecessary if using Heroku quick deploy, and restructured to include local setup instructions as well.
2020-04-25 11:30:44 -06:00
Ben Busby 38c0f56322 Fixed gitignore, added required files 2020-04-24 19:03:22 -06:00
Ben Busby 1f6bfa092e Complete refactoring of opensearch
Refactored opensearch.xml to only exist as a template that is
served by a flask route, which is then populated with the
necessary url root.
2020-04-24 18:45:57 -06:00
Ben Busby 02bb5a3426 Merge branch 'master' of github.com:benbusby/shoogle 2020-04-24 18:11:51 -06:00
Ben Busby 9c7b4c1444 Fixed bad test assertion
Was previously checking for non-inclusive max number of days (i.e.
filtering by past month would return a failed test if the result was
from exactly 31 days ago)
2020-04-24 18:10:57 -06:00
Ben Busby 79f5c607eb
Update README.md
Added clarification for prerequisites if using the Heroku single-click deploy option
2020-04-24 18:06:28 -06:00
Ben Busby ae94650aee
Updated README
Added single click deploy option for heroku
2020-04-24 18:02:28 -06:00
Ben Busby 4fb8ab6cac Added heroku.yml 2020-04-24 17:56:16 -06:00
Ben Busby a678c2e89d Updated app.json to use container stack 2020-04-24 17:53:45 -06:00
Ben Busby 482c93b09a
Added missing web dyno formation 2020-04-24 17:43:30 -06:00
Ben Busby 831d111c55
Updated app.json
Added a postdeploy option to run the application after it finishes building
2020-04-24 17:35:02 -06:00
Ben Busby 1c5f57e692
Fixed travis CI
Previous commit relocated requirements.txt back to the root level of the repo, but Travis wasn't updated accordingly.
2020-04-24 17:27:21 -06:00
Ben Busby 525f7adf22 Merge branch 'master' of github.com:benbusby/shoogle 2020-04-24 17:25:06 -06:00
Ben Busby e21341d6f4 Deployment related refactoring, fixes to Dockerfile
- Updated Dockerfile to include chmod of run script
- Added app.json for Heroku quick deploy
- Removed unused function var in js controller
- Moved requirements back to root of repo
- Added Codebeat report to readme
2020-04-24 17:23:08 -06:00
Ben Busby a7005c012e Refactoring of user requests and routing
Curl requests and user agent related functionality was moved to its own
request class.

Routes was refactored to only include strictly routing related
functionality.

Filter class was cleaned up (had routing/request related logic in here,
which didn't make sense)
2020-04-23 20:59:43 -06:00