I tried using PaperSpace for a while but it works maybe 1 in 3 times I tried to use it, they (temporarily) banned me for no reason, they send me "itemized" bills with empty line items, and their support was no help.
If getting a gpu is not practical, I'd try one of the K80s or other cheaper GPUs on AWS for all your debugging and then port to the more expensive instances only if you need them. Doing this as a hobbyist will be relatively inexpensive. I think a lot of the cost incurred as a hobbyist comes from reserving a gpu when you don't actually need it.
OVH charges $2 per hour for a V100S
I'm also not a fan of having to upload files to Google Drive and then write special code to import them. It means my code isn't portable to run locally or anywhere else and it's just extra effort. I just want normal file access and to write scripts like I normally would.
Still, I was spurred to ask the question because some people are categorically opposed to anything Google due to privacy issues.
That's a use case more suited to running a VM itself.
Hobbyists often use our free tier (30 hrs of GPU per month) or pay for more compute ($0.69/hour) to do a variety of GPU workloads.
We do prohibit things like DDOS attacks and cryptocurrency mining.
paid services on AWS:
- Amazon Sagemaker Studio
- Amazon Sagemaker Notebook Instances (think EC2 + jupyter + integration with AWS services)
They provide persistent storage and access to the full JupyterLab or Jupyter Notebook software, unlike Colab. I find this makes life far easier, since all my normal terminal workflows work fine.
OVH actually has a (distantly) similar service (much less user friendly than grid and without the whole "grid" feature, but that matters less for hobbyists if you're not doing a lot of parallel runs). I liked the OVH one a lot in principle, but in practice found it too buggy to use properly (and they don't have customer support). For a budget project it could be worth trying.
I've migrated several notebooks from Colab to JupyterLab when playing around with various generative art models; it's a drop-in replacement and runs on your local machine's hardware.
I did have to do some fiddling to install a bunch of Nvidia crap on my local machine, however; blame CUDA.
Disclaimer: I work for Deepnote
The GPU add-on cost is about 7.50$ per hour for a 12 GB K80 (which has 24GB, so you share it? Also, it's from 8? years ago?). As an add-on, other vendors would give you V100s (possibly multiple ones).
I am pretty sure that's not actually what you are offering, because that would be ridiculous. So you probably want to update your pricing page ;-)
Perhaps it just follows Google cloud's user data policy as long as you're using a paid service? But the latter might be a legitimate concern; some customer may ask their data not to leave any networks outside the contract and depending on this types of public services will increases the likelihood of such accidents.
Same thing Microsoft does with Windows, github and VSCode.
Just hoovering up all the ideas you have.
I'd honestly be shocked if Google/Microsoft are monitoring the clients of their public cloud and keeping the data to create their own products off of.
A breach in that area would cost them potentially billions in losses.
Source: I work on FedRAMP compliance for GCP Databases.
AWS US East-West (Northern Virginia, Ohio, Oregon, Northern California) is FedRAMP compliant at moderate impact level.
Outside of the DoD space, the main distinctions between these offerings is where data can be stored and where and to what level of vetting vendor employees are.
[1]: https://www.wsj.com/articles/amazon-scooped-up-data-from-its...
they have access to the private data, by definition. the entire point is that it's not exposed nor is it used. clearly you've never worked at one of the companies in question lol. when you're on-call you might need to actually access private data.
true data sovereignty products are something countries in the EU are wanting USA companies to implement though, so then it's simply inaccessible, not public or private.
the industry is moving in this direction with things like AWS Outposts
When I was on-call and had to dive deep to solve customers' issues at one of those companies, we could only access anonymized data stripped of all PII (including emails and even IP addresses), to the point where the only non-scrambled things we could get were timestamps and error stacktraces/executed commands (which were also stripped of all PII, which made debugging a bit more difficult).
And every instance of access to that anonymized no-PII data required a physical authenticator, and it would automatically send an email to your manager (and some mailing group, i forgot) and create a special log that indicated "such and such was trying to access this anonymized ABC data for XYZ stated purpose".
and contact them through Signal or whatever.
Read this and learn! The Gentleperson's Guide To Forum Spies (spooks, feds, etc.) https://cryptome.org/2012/07/gent-forum-spies.htm
What's the harm in that, you know? The worst that would happen is that corporations would have a hard time astroturfing. The best that would happen is there'd be less PR.
All you had to do was copy one of the opening paragraphs from a thread on a forum website like dosbods.co.uk or housepricecrash.co.uk and then paste it into Google and then you could see the exact same starting conversations, word for word taking place on a variety of websites, like pistonheads, mumsnet and others. The press help elevate websites like mumsnet to help with the "consensus cracking" aka psychological manipulation.
Different avatars, but the conversations always started off word for word identical because invariably non spooky sock puppets ie members of the public would join in the conversation so then it would deviate off. This is one of the methods to phish people.
The spooks were on house price crash because they wanted to know why people on there were hoping for a crash. The reason being is maslow's heirachy of needs, suggests shelter is one of the basic needs, so mortgages are a way of controlling people en-masse which we have seen since the late 90's with property prices going through the roof and endless hours of property porn on tv. Northern Rock 125% mortgages showed people would over extend themselves for the idea that on paper they were rich and gambling on capital appreciation without realising tax rules may change in the future. Its one of the many many ways the so called free press have played their part in manipulating and controlling the public, along with the banks lending without caution etc etc, but this is the beuaty of the hierarchical structure of control, beit employment or other entities which control everyone's lives.
I've actually met former head of MI5 Andrew Parker, in Bishop's Stortford, but I didnt know him, I only recognised him when he did a speech on terrorism some years later that was broadcast on the BBC 6 o clock news. What was interesting is he used his real life accent when talking to me, but used the BBC Received Pronunciation when doing the speech on Terrorism. I also met James Brokenshire MP then Tory housing minister, with Dame Stella Rimmington & Baron Jonathan Evans at the pump house at Wastwater, Scafell Pike, the day after Theresa May called the election! It was their way of telling me they were operating on Housepricecrash.co.uk. Why else would they drag the govt housing minister up to Scafell Pike when he was supposed to be off getting lung cancer treatment!?!
Its the spooks job to protect the economy, so phishing people looking for a housing crash is one remit, however they didnt realise they were giving themselves away in more ways than one! I'm always reminded the smallest of viruses can kill the largest of hosts! ROFL
That aside, I don't think I find this too upsetting. They don't let people e.g. mine cryptocurrency either, I think it's fine that they limit how you can use their free (or cheap) "service".