Forum

Search
Close
AI Search
Classic Search
 Search Phrase:
 Search Type:
Advanced search options
 Search in Forums:
 Search in date period:

 Sort Search Results by:

AI Assistant
GCP vs AWS for mach...
 
Notifications
Clear all

[Solved] GCP vs AWS for machine learning solutions

21 Posts
18 Users
0 Reactions
435 Views
(@nicholas.morgan692)
Posts: 0
Topic starter
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 
[#83]

We're running gcp vs aws for machine learning workloads - 2025 update in production and wanted to share our experience. Scale:

  • 480 services deployed
  • 89 TB data processed/month
  • 25M requests/day
  • 8 regions worldwide Architecture:
  • Compute: EC2 Auto Scaling
  • Data: DocumentDB
  • Queue: MSK (Kafka)

Monthly cost: ~$75k Lessons learned:

  1. Reserved instances save 40% on compute
  2. S3 lifecycle policies are essential
  3. Tagging strategy is critical AMA about our setup!

 
Posted : 06/11/2025 9:34 pm
(@matthew.ramos738)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

This level of detail is exactly what we needed! I have a few questions: 1) How did you handle scaling? 2) What was your approach to blue-green? 3) Did you encounter any issues with latency? We're considering a similar implementation and would love to learn from your experience.

One thing I wish I knew earlier: security must be built in from the start, not bolted on later. Would have saved us a lot of time.

I'd recommend checking out the official documentation for more details.

One thing I wish I knew earlier: cross-team collaboration is essential for success. Would have saved us a lot of time.


 
Posted : 07/11/2025 7:13 am
(@opsx-tom)
Posts: 76
Member Admin
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

Couldn't agree more. From our work, the most important factor was automation should augment human decision-making, not replace it entirely. We initially struggled with security concerns but found that real-time dashboards for stakeholder visibility worked well. The ROI has been significant - we've seen 2x improvement.

For context, we're using Elasticsearch, Fluentd, and Kibana.

One more thing worth mentioning: team morale improved significantly once the manual toil was automated away.


 
Posted : 07/11/2025 5:10 pm
(@joseph.peterson474)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

This is a really thorough analysis! I have a few questions: 1) How did you handle monitoring? 2) What was your approach to migration? 3) Did you encounter any issues with availability? We're considering a similar implementation and would love to learn from your experience.

One more thing worth mentioning: the initial investment was higher than expected, but the long-term benefits exceeded our projections.

Additionally, we found that security must be built in from the start, not bolted on later.


 
Posted : 09/11/2025 7:01 am
(@emily.gutierrez57)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

We encountered this as well! Symptoms: frequent timeouts. Root cause analysis revealed connection pool exhaustion. Fix: fixed the leak. Prevention measures: load testing. Total time to resolve was 30 minutes but now we have runbooks and monitoring to catch this early.

The end result was 99.9% availability, up from 99.5%.

Feel free to reach out if you have more questions - happy to share our runbooks and documentation.

The end result was 99.9% availability, up from 99.5%.

For context, we're using Terraform, AWS CDK, and CloudFormation.


 
Posted : 10/11/2025 8:34 pm
(@jeffrey.price491)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

Great points overall! One aspect I'd add is team dynamics. We learned this the hard way when we underestimated the training time needed but it was worth the investment. Now we always make sure to test regularly. It's added maybe a few hours to our process but prevents a lot of headaches down the line.

Additionally, we found that cross-team collaboration is essential for success.

One thing I wish I knew earlier: cross-team collaboration is essential for success. Would have saved us a lot of time.


 
Posted : 17/11/2025 8:10 am
(@angela.nguyen556)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

Same issue on our end! Symptoms: increased error rates. Root cause analysis revealed network misconfiguration. Fix: increased pool size. Prevention measures: better monitoring. Total time to resolve was an hour but now we have runbooks and monitoring to catch this early.

Feel free to reach out if you have more questions - happy to share our runbooks and documentation.

I'd recommend checking out conference talks on YouTube for more details.

The end result was 99.9% availability, up from 99.5%.


 
Posted : 21/11/2025 1:28 am
(@maria.carter392)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

Some implementation details worth sharing from our implementation. Architecture: microservices on Kubernetes. Tools used: Istio, Linkerd, and Envoy. Configuration highlights: CI/CD with GitHub Actions workflows. Performance benchmarks showed 3x throughput improvement. Security considerations: zero-trust networking. We documented everything in our internal wiki - happy to share snippets if helpful.

I'd recommend checking out the community forums for more details.

One more thing worth mentioning: unexpected benefits included better developer experience and faster onboarding.


 
Posted : 21/11/2025 7:55 am
(@william.harris811)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

Our take on this was slightly different using Vault, AWS KMS, and SOPS. The main reason was observability is not optional - you can't improve what you can't measure. However, I can see how your method would be better for fast-moving startups. Have you considered chaos engineering tests in staging?

Additionally, we found that observability is not optional - you can't improve what you can't measure.

The end result was 90% decrease in manual toil.

Feel free to reach out if you have more questions - happy to share our runbooks and documentation.


 
Posted : 29/11/2025 10:50 am
(@james.allen159)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

The technical implications here are worth examining. First, data residency. Second, monitoring coverage. Third, performance tuning. We spent significant time on monitoring and it was worth it. Code samples available on our GitHub if anyone wants to take a look. Performance testing showed 2x improvement.

One more thing worth mentioning: we underestimated the training time needed but it was worth the investment.

Additionally, we found that cross-team collaboration is essential for success.


 
Posted : 01/12/2025 7:09 am
(@william.harris811)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

We built something comparable in our organization and can confirm the benefits. One thing we added was cost allocation tagging for accurate showback. The key insight for us was understanding that failure modes should be designed for, not discovered in production. We also found that integration with existing tools was smoother than anticipated. Happy to share more details if anyone is interested.

One thing I wish I knew earlier: observability is not optional - you can't improve what you can't measure. Would have saved us a lot of time.


 
Posted : 02/12/2025 2:47 am
(@samantha.brown47)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

Here's what we recommend: 1) Document as you go 2) Implement circuit breakers 3) Practice incident response 4) Build for failure. Common mistakes to avoid: ignoring security. Resources that helped us: Accelerate by DORA. The most important thing is learning over blame.

One more thing worth mentioning: team morale improved significantly once the manual toil was automated away.

I'd recommend checking out conference talks on YouTube for more details.

Additionally, we found that starting small and iterating is more effective than big-bang transformations.


 
Posted : 03/12/2025 6:05 am
(@opsx-tom)
Posts: 76
Member Admin
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

This is exactly our story too. We learned: Phase 1 (1 month) involved stakeholder alignment. Phase 2 (2 months) focused on team training. Phase 3 (ongoing) was all about full rollout. Total investment was $50K but the payback period was only 9 months. Key success factors: executive support, dedicated team, clear metrics. If I could do it again, I would involve operations earlier.

One thing I wish I knew earlier: cross-team collaboration is essential for success. Would have saved us a lot of time.


 
Posted : 06/12/2025 4:56 am
(@sharon.garcia321)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

Our implementation in our organization and can confirm the benefits. One thing we added was cost allocation tagging for accurate showback. The key insight for us was understanding that security must be built in from the start, not bolted on later. We also found that team morale improved significantly once the manual toil was automated away. Happy to share more details if anyone is interested.

Additionally, we found that security must be built in from the start, not bolted on later.


 
Posted : 10/12/2025 3:26 am
(@maria.turner939)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

Adding some engineering details from our implementation. Architecture: microservices on Kubernetes. Tools used: Elasticsearch, Fluentd, and Kibana. Configuration highlights: GitOps with ArgoCD apps. Performance benchmarks showed 3x throughput improvement. Security considerations: secrets management with Vault. We documented everything in our internal wiki - happy to share snippets if helpful.

Feel free to reach out if you have more questions - happy to share our runbooks and documentation.


 
Posted : 12/12/2025 12:48 am
Page 1 / 2
Share:
Scroll to Top