My Own Private (or public) Google

Post date: 2020-12-04 04:37:13
Views: 532
I have a hard drive with ~3TB of assorted files (html, video, etc.) scraped from a large (public) website at a finite point in time. The files aren't arranged in a particularly human-readable way, but (I think?) in folders by file type. How do I make them my own private google -- or open to the public is fine?

My goal is to have this archive in a format where a relatively small number of people could pull up a browser, enter text (or filetype) in a search field, and have relevant results pop up -- really, exactly what Google does. It could be a system where they need to set up an account (ideally free for them), or something open to the public (not sensitive, if not popular either).

Difficulty: I understand computers, and 10 years ago might have clawed my way into setting up my own CMS, and maybe an SQL install or something, but I'd rather just have an off-the-shelf product that works quickly and that I can set up with less terminal and more mouse. I'm willing to pay ~$20/month, or maybe more (since this is potentially time limited).

One idea I had was just to set up a google drive account, create a shared drive, and upload everything there (though I think uploads are limited to 750GB or something/day). I can try to trim it to under 2GB (the jump from 2GB for $9.99 to 10TB for $49.99 is massive)... Or should I just try to get the data into the cloud somewhere, hope Google indexes it, and create a one-page web interface that routes searches to site:xyz? (Does "hope Google indexes it" work here?)

Other ideas are welcome! Thank you!
Number of Comments
Please click Here to read the full story.
 
Other Top and Latest Questions:
Stocks making the biggest moves premarket: Anthropic, Ross Stores, Gap & more
Kushner says Russia 'comfortable' with idea of NATO-like security guarantees for Ukraine
S&P 500 heads for 6th straight decline. Plus, J&J advances two key products
Kraken parent's acquisition of Tribe Capital flags new chapter in evolution of crypto exchanges
How do I HSA?
[Free Plugin] Truth or Dare Roulette for Answers (Customizable Colors & Dynamic PNG Badge)
Cupertino: Judith and Michael
Anthropic raises $93.5 billion total as underwriters scoop up ‘greenshoe’ overallotment
A24 is having a great year at the box office. That could give HBO Max a streaming edge
Forget Anthropic: In Europe, the IPO hype is about a blue lagoon