• Announcements

    • MannDude

      Current state of vpsBoard   02/04/2017

      Dear vpsBoard members and guests:

      Over the last year or two vpsBoard activity and traffic has dwindled. I have had a change of career and interests, and as such am no longer an active member of the web hosting industry.

      Due to time constraints and new interests I no longer wish to continue to maintain vpsBoard. The web site will remain only as an archive to preserve and showcase some of the great material, guides, and industry news that has been generated by members, some of which I remain in contact to this very day and now regard as personal friends.

      I want to thank all of our members who helped make vpsBoard the fastest growing industry forum. In it's prime it was an active and ripe source of activity, news, guides and just general off-topic banter and fun.

      I wish all members and guests the very best, whether it be with your business or your personal projects.

Sign in to follow this  
Followers 0

GitLab: Time to Leave the Cloud (bare-metal vs shared-environment virtualization)

3 posts in this topic

What we found is that the cloud was not meant to provide the level of IOPS performance we needed to run an agressive system like CephFS.


The problem with CephFS is that in order to work, it needs to have a really performant underlaying infrastructure because it needs to read and write a lot of things really fast. If one of the hosts delays writing to the journal, then the rest of the fleet is waiting for that operation alone, and the whole file system is blocked. When this happens, all of the hosts halt, and you have a locked file system; no one can read or write anything and that basically takes everything down.


Recap: What We Learned

  1. CephFS gives us more scalability and ostensibly performance but did not work well in the cloud on shared resources, despite tweaking and tuning it to try to make it work.
  2. There is a threshold of performance on the cloud and if you need more, you will have to pay a lot more, be punished with latencies, or leave the cloud.
  3. Moving to dedicated hardware is more economical and reliable for the scale and performance of our application.
  4. Building an observable system by pulling and aggregating performance data into understandable dashboards helps us spot non-obvious trends and correlations, leading to addressing issues faster.
  5. Monitoring some things can be really application specific which is why we are building our own gitlab-monitor Prometheus exporter. We plan to ship this with GitLab CE soon.



1 person likes this

Share this post

Link to post
Share on other sites

That's actually interesting.  Especially since right now many people are going TO Cloud over Bare Metal.  Most usually state that the reliability of cloud hardware over bare metal is what usually drives it (and usually the concept that cloud is much easier to scale over bare metal).  

1 person likes this

Share this post

Link to post
Share on other sites

It is easier to scale at a trivial level (adding resources is easy). It makes the easy problems easier.

I doubt it makes the hard problem of developing a scalable architecture easier.

I have personally found that an easier a service is to get started with, (particularly things like Heroku that have very quick set up) the more likely you are to run into things you cannot easily do.

1 person likes this

Share this post

Link to post
Share on other sites
Sign in to follow this  
Followers 0

  • Similar Content

    • By web-project
      All our VPS plans comes with Anti-DDoS protection and we do offer price match guarantee on our unmanaged VPS range.
      Basic Custom Plan - Special
      Guaranteed RAM: 4096MB (4GB)
      Disk Space: 200GB
      Bandwidth: 5000GB on 1 Gbps port*
      Dedicated IP (IPv4): 2
      Dedicated IP (IPv6): 50
      CPU: 6 vCPU Fair Use
      Control Panel: SolusVM control panel
      Full Root Access: Yes
      Raid Protected Storage: Yes
      Virtualization: Xen HVM
      Server Location: Roubaix, France (EU)
      Cost per month: £8.00 (don't need any coupon code, as price reduced automatically on checkout or you can use coupon: VPSBASICSPECIAL)
      Buy Now: https://www.web-project.co.uk/clientarea/order.php?step=1&productGroup=20&product=188
      (for any late payments £25 charge fee and removal of lifetime discount as per terms and conditions)

      More information about SolusVM XEN VPS - Basic VPS Plans at URL:
      * - shared between other VMs on the VPS node
      Need Storage VPS Plans, visit URL:
      The above VPS plan come with unmanaged support, if you can't handle the server administration we recommend the managed plans, visit our website for more information:

      Operating Systems Available:
      - CentOS 6.x and 7 (64Bit)
      - Debian 7.0 / Debian 8.0 ( 64Bit)
      - Latest Fedora (64Bit)
      - CloudLinux
      - any other OS on request

      Control Panel Available: 
      - SSH Access / Without Control Panel 
      - Webmin Control Panel (optional)
      - cPanel and WebHost Manager (optional)
      - Vesta (optional)
      - Kloxo (optional)
      - ISPConfig 2 (optional)
      - ISPConfig 3 (optional)

      Network Speed:
      Basic VPS Network
      Test ping IP:
      Test file:

      Need more information? 
      Have any questions?
      Email:[email protected] your sales inquiries
    • By ikoula
      i agree that is not a dedi but the usage is so close i allowed myself to post it here, if that's not right be my guest Mr moderator and move it :)
      We offer a new storage service based on Synology Diskstation DS115j

      -Marvell Armada 370 processor
      -256 MB Ram
      -2 TB Sata Hd
      -1 public ip included
      -100 Mbps Full Duplex
      -Location : Ikoula Datacenter France
      -DSM 6.0
      Usages and Functionalities
      Backup server, file synchronisation and file share.
      Synchronise your files with Cloud services
      For more information and other usages see Synology's website.
      -Setup fee : FREE until 31th of August 2016.
      -No commitment
      -Satisfied or refunded during 30 days.
      -Price : 14.99€ exc VAT/ Month
      Accepted methods of payments
      -Credit cards
      -Bank tranfer
      To test it
      Ikoula order page
      Operating since 1998 and we own our datacenter. More info here.
      Feel free to ask if you have any question.
    • By HalfEatenPie
      Full Article: http://www.extremetech.com/extreme/222267-seagate-faces-lawsuit-over-3tb-hard-drive-failure-rates
      My only response to this is: lol.
    • By lbft
      Amazon's Glacier is cheap (1 cent per GB per month) but it comes with long waits to retrieve data, and retrieval costs can jump quite high if you pull a lot of your data at once (like, say, restoring a big backup). Then this year Google released their Nearline Storage product earlier this year also at 1 cent per GB per month, but only 1 cent per GB to retrieve (+ bandwidth costs) and with a three second retrieval time (rather than Glacier's 3-5 hours).
      So now Amazon's dropped Glacier to 0.7 cents per GB per month and come out with a new product: S3 Standard - Infrequent Access Storage (they need to work on their naming!) The tl;dr is 1.25 cents per GB per month, 1 cent per GB to retrieve (+ bandwidth costs), minimum 30 day storage charge, minimum size 128KB and S3-like retrieval performance. It's still more expensive than Google's product, which is interesting, but S3 does have goodies around automatically moving stuff from S3 to cheaper storage when it gets beyond a certain age, which makes it a useful option to consider for those already using Amazon's ecosystem (which is a lot of people, considering the large number of services offered under the AWS umbrella).
      Anyone here considering using the new thing?
    • By RaidLogic.NET
      RaidLogic.NET by DTS-NET  Virtual Private Server line is the ideal solution for clients who require the control of a dedicated server matched with the affordability and simplicity of a traditional shared hosting account. Look over our plans, standard features and customization options. You can order and customize your plan online and we'll get you set up right away. If you have any questions, please contact us by phone, e-mail or live chat.   URL: http://www.raidlogic.net  Email: [email protected] Livechat: http://www.raidlogic.net/support/
        ============================================================= RaidLogic.NET VPS (Virtual Private Servers) Linux - Self Managed =============================================================   Your Virtual Private Server includes the following:   Redundant power backup. Automated generator system. Failed hardware replacement. 99.9% uptime guarantee. No long term contract. Intel® or AMD® Processors. Full root access. Access to VPS control panel. Free reboot ticket submission. Free CISCO™ GUARD DDOS protection. 24x7x365 technical support. 24x7x365 network monitoring. Private MRTG links* 1 IPv4 address and upgrade if you need more goto  http://www.raidlogic.net offering 50% off your first payment when using the coupon "raidlogicvpsboard". This can be applied to any payment term (monthly, annual, and 3 year)   bringing Professional, Affordable and Quality VPS solutions to users all around the globe. offer everything larger companies do & even more, but for only a fraction of the cost.

      we bring you our limited time "FREE MIGRATION + SETUP + INSTALL" Virtual Private Server Packages starting @ ONLY $9.95

      FREE Migration & Customizations/Installations included in all VPS, just contact us after signup
      (Ex: Migration from Plesk, cPanel and other platforms, Installation of Custom PHP5 modules, cloud, ffmpeg, red5, plex media server,ruby, java and more, just request it! )

      Get Questions Answered! Call us. LiveChat with us 24/7/365

      Price Match Guarantee

      will price match the features and lowest current listed price of the following most popular hosting companies.

      All we need is your First & Last Name Email Address Your Domain/Website Name of Host to Price Match URL of Hosting Plan to Price Match.

      Send either here on live chat or click on contact us or open a support ticket.

      Find a competitor with a similar level of service, network, and infrastructure with a lower price?

      Contact our team today with a copy of the competitors quote and let our team match or beat their offered pricing!

      Requirements for Price Match consideration:

      - Provider must be a Legal company in business for 1+ Years

      - Plans must include Unmetered data transfer

      - Provider must offer 24x7 PHONE, Live Chat and Ticket Support Price Match Guarantee is limited to one price match per hosting plan, per client and does not apply to: Promotional pricing valid for original term.