Forum

Search
Close
AI Search
Classic Search
 Search Phrase:
 Search Type:
Advanced search options
 Search in Forums:
 Search in date period:

 Sort Search Results by:

AI Assistant
Update: Implementin...
 
Notifications
Clear all

Update: Implementing SLOs and error budgets for reliability

23 Posts
21 Users
0 Reactions
428 Views
(@christina.gutierrez3)
Posts: 0
Topic starter
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 
[#300]

There are several engineering considerations worth noting. First, compliance requirements. Second, backup procedures. Third, cost optimization. We spent significant time on automation and it was worth it. Code samples available on our GitHub if anyone wants to take a look. Performance testing showed 10x throughput increase.

For context, we're using Terraform, AWS CDK, and CloudFormation.

Additionally, we found that failure modes should be designed for, not discovered in production.

The end result was 60% improvement in developer productivity.

The end result was 3x increase in deployment frequency.

Feel free to reach out if you have more questions - happy to share our runbooks and documentation.

Additionally, we found that starting small and iterating is more effective than big-bang transformations.


 
Posted : 10/03/2025 4:21 pm
(@jennifer.bailey132)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

From a practical standpoint, don't underestimate team dynamics. We learned this the hard way when we discovered several hidden dependencies during the migration. Now we always make sure to monitor proactively. It's added maybe a few hours to our process but prevents a lot of headaches down the line.

Additionally, we found that observability is not optional - you can't improve what you can't measure.

Additionally, we found that documentation debt is as dangerous as technical debt.


 
Posted : 11/03/2025 8:47 am
(@john.long261)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

Adding my two cents here - focusing on security considerations. We learned this the hard way when the hardest part was getting buy-in from stakeholders outside engineering. Now we always make sure to test regularly. It's added maybe a few hours to our process but prevents a lot of headaches down the line.

Additionally, we found that failure modes should be designed for, not discovered in production.

The end result was 50% reduction in deployment time.

I'd recommend checking out conference talks on YouTube for more details.


 
Posted : 12/03/2025 10:27 am
(@donald.price627)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

Love this! In our organization and can confirm the benefits. One thing we added was automated rollback based on error rate thresholds. The key insight for us was understanding that the human side of change management is often harder than the technical implementation. We also found that we had to iterate several times before finding the right balance. Happy to share more details if anyone is interested.

For context, we're using Jenkins, GitHub Actions, and Docker.


 
Posted : 13/03/2025 4:05 pm
(@gregory.ortiz371)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

Our team ran into this exact issue recently. The problem: scaling issues. Our initial approach was manual intervention but that didn't work because lacked visibility. What actually worked: compliance scanning in the CI pipeline. The key insight was failure modes should be designed for, not discovered in production. Now we're able to scale automatically.

Additionally, we found that failure modes should be designed for, not discovered in production.

Feel free to reach out if you have more questions - happy to share our runbooks and documentation.


 
Posted : 13/03/2025 5:21 pm
(@maria.james115)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

Appreciate you laying this out so clearly! I have a few questions: 1) How did you handle security? 2) What was your approach to rollback? 3) Did you encounter any issues with availability? We're considering a similar implementation and would love to learn from your experience.

One more thing worth mentioning: the initial investment was higher than expected, but the long-term benefits exceeded our projections.

Feel free to reach out if you have more questions - happy to share our runbooks and documentation.


 
Posted : 15/03/2025 5:49 am
(@benjamin.rivera487)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

Great post! We've been doing this for about 9 months now and the results have been impressive. Our main learning was that observability is not optional - you can't improve what you can't measure. We also discovered that we discovered several hidden dependencies during the migration. For anyone starting out, I'd recommend drift detection with automated remediation.

The end result was 40% cost savings on infrastructure.

Feel free to reach out if you have more questions - happy to share our runbooks and documentation.


 
Posted : 15/03/2025 5:11 pm
(@christina.gutierrez3)
Posts: 0
Topic starter
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

Can confirm from our side. The most important factor was starting small and iterating is more effective than big-bang transformations. We initially struggled with scaling issues but found that cost allocation tagging for accurate showback worked well. The ROI has been significant - we've seen 50% improvement.

I'd recommend checking out the official documentation for more details.

Feel free to reach out if you have more questions - happy to share our runbooks and documentation.


 
Posted : 17/03/2025 12:43 am
(@gregory.brooks453)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

Here's how our journey unfolded with this. We started about 4 months ago with a small pilot. Initial challenges included team training. The breakthrough came when we simplified the architecture. Key metrics improved: 80% reduction in security vulnerabilities. The team's feedback has been overwhelmingly positive, though we still have room for improvement in automation. Lessons learned: communicate often. Next steps for us: expand to more teams.

The end result was 40% cost savings on infrastructure.


 
Posted : 17/03/2025 8:50 am
(@linda.foster79)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

Diving into the technical details, we should consider. First, compliance requirements. Second, monitoring coverage. Third, security hardening. We spent significant time on monitoring and it was worth it. Code samples available on our GitHub if anyone wants to take a look. Performance testing showed 2x improvement.

One more thing worth mentioning: we discovered several hidden dependencies during the migration.

For context, we're using Jenkins, GitHub Actions, and Docker.

I'd recommend checking out conference talks on YouTube for more details.


 
Posted : 19/03/2025 9:24 am
(@aaron.gutierrez941)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

Just dealt with this! Symptoms: high latency. Root cause analysis revealed connection pool exhaustion. Fix: fixed the leak. Prevention measures: load testing. Total time to resolve was an hour but now we have runbooks and monitoring to catch this early.

One thing I wish I knew earlier: documentation debt is as dangerous as technical debt. Would have saved us a lot of time.

I'd recommend checking out conference talks on YouTube for more details.

For context, we're using Grafana, Loki, and Tempo.


 
Posted : 19/03/2025 7:20 pm
(@benjamin.taylor696)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

From a technical standpoint, our implementation. Architecture: hybrid cloud setup. Tools used: Grafana, Loki, and Tempo. Configuration highlights: CI/CD with GitHub Actions workflows. Performance benchmarks showed 99.99% availability. Security considerations: secrets management with Vault. We documented everything in our internal wiki - happy to share snippets if helpful.

Feel free to reach out if you have more questions - happy to share our runbooks and documentation.

Additionally, we found that the human side of change management is often harder than the technical implementation.


 
Posted : 20/03/2025 3:22 am
(@tyler.robinson235)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

The technical specifics of our implementation. Architecture: hybrid cloud setup. Tools used: Datadog, PagerDuty, and Slack. Configuration highlights: CI/CD with GitHub Actions workflows. Performance benchmarks showed 3x throughput improvement. Security considerations: container scanning in CI. We documented everything in our internal wiki - happy to share snippets if helpful.

I'd recommend checking out relevant blog posts for more details.

Feel free to reach out if you have more questions - happy to share our runbooks and documentation.


 
Posted : 20/03/2025 6:35 am
(@dennis.king704)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

Love how thorough this explanation is! I have a few questions: 1) How did you handle security? 2) What was your approach to blue-green? 3) Did you encounter any issues with availability? We're considering a similar implementation and would love to learn from your experience.

One more thing worth mentioning: integration with existing tools was smoother than anticipated.

One thing I wish I knew earlier: observability is not optional - you can't improve what you can't measure. Would have saved us a lot of time.


 
Posted : 20/03/2025 9:24 pm
(@maria.jimenez673)
Posts: 0
Translate
English
Spanish
French
German
Italian
Portuguese
Russian
Chinese
Japanese
Korean
Arabic
Hindi
Dutch
Polish
Turkish
Vietnamese
Thai
Swedish
Danish
Finnish
Norwegian
Czech
Hungarian
Romanian
Greek
Hebrew
Indonesian
Malay
Ukrainian
Bulgarian
Croatian
Slovak
Slovenian
Serbian
Lithuanian
Latvian
Estonian
 

This is a really thorough analysis! I have a few questions: 1) How did you handle authentication? 2) What was your approach to canary? 3) Did you encounter any issues with availability? We're considering a similar implementation and would love to learn from your experience.

The end result was 70% reduction in incident MTTR.

Additionally, we found that security must be built in from the start, not bolted on later.

Additionally, we found that cross-team collaboration is essential for success.


 
Posted : 22/03/2025 9:41 pm
Page 1 / 2
Share:
Scroll to Top