How to use online render farms

How to use online render farms

And save time, money, eliminate stress and maximize your earning potential with cloud rendering

Contents

1. Introduction

In the past few years the market for a render farm service has increased to meet the growing need for fast deliverables in the CG industry. Big render farms created by movie studios existed earlier but they were separated from the outside world by slow internet connection. The increase of internet bandwidth made the computing centers accessible from any computer connected to the Web, starting the boom of all cloud services, especially for rendering computer graphics via online render farms.

An online render farm is an ideal solution for freelancers and studios who need access to more rendering power on demand. The time spent uploading and rendering combined will be far shorter than rendering a whole frame range on a workstation or even a few machines. You could even send a single image over to a farm, where it will be divided into strips that will render in parallel and merged to the final frame after. Time is money, after all, and, cloud render farms are the ultimate time saver. Besides that, they also spare you the headache from:

  • the hassle of investing in a server room 
  • purchasing and managing multiple render licenses 
  • troubleshooting hardware issues 
  • buying new parts and new computers every 3-5 years 
  • dealing with unused bare metal during low seasons

More often than not, a render farm service would provide plugins that can integrate into your software, making it just another tool you’d add to your production pipeline. 

Just like any CG tool, rendering on a farm isn't a magic button that will get you the results you want in a single click. While indispensable for client work, render farms can also leave you with unusable frames and a burning hole in your wallet if you don't take some necessary precautions. The better you know a tool, the more you gain from using it.

This guide will help you avoid making rookie mistakes, and get familiar with the tool, so that you can use cloud farms efficiently and make the most of your time and money spent on rendering.

2. Cost estimation

Every render farm service should give information about their pricing as a price per hour of rendering on one node, Ghz hour, or some other measurable unit of node usage. This information is good to have when trying to get a general idea of the cost, but will only ever be an approximation at best and won’t tell you what the precise cost of rendering a specific project would be.

This is why many render farms offer cost calculators. We here at GarageFarm.NET have our own tool that calculates render farm costs to help you get a scene cost estimate before making any commitment to the service.

Cost calculators

Render farms cannot predict how much a project will cost you just based on the animation’s length, the number of frames or output resolution. It’s technically impossible. That’s where cost calculators come in.

The way they work varies from render farm to render farm, but is generally quite easy to follow. Cost calculators generate an estimate of the cost of rendering of a project by comparing speed benchmarks of a farm’s processing power against yours. They multiply this ratio (farm speed vs. your speed) by the average time of rendering one frame on your computer, the number of frames, and finally by the rendering cost per time unit. Let’s take a look at some examples.

The example above shows a calculation of the total rendering time of a scene on a farm. The cost of rendering such a scene is based on the resulting total time, and multiplied by a cost rate.

Based on the total rendering time we got in the first example, we can now calculate the cost of rendering.

The cost of one hour of rendering will depend on a service and the plans or priorities they offer. In addition to those, some render farms offer volume discounts and special packages for larger payments. These discounts often don’t lower the price itself but give additional render credits on top of what you paid for.

This system can be an enormous cost saver in the long run and is especially beneficial to studios with high rendering needs.

In the above example, a general cost rate for one hour of rendering with 1Ghz speed is multiplied by the power of the specific processor. The result is a cost rate for rendering with the given processor for one hour.

Render farms will often use “Ghz Hour” as a unit of billing. This particular way of presenting the cost rate is more universal and often easier to use when comparing different farms. In many cases, render farms are built from nodes which use various types of processors and so the final cost rate depends on their speed.

The equation above shows how much time your job will need to finish rendering – from the moment your project finishes uploading to farm to the time when the last frame is completed.

It depends on several factors:

  • Total rendering time – depends on your projects volume and rendering time per frame on one node
  • Wait time – determined by the priority/plan you chose, the availability of nodes, and your place relative to others who have launched jobs before you and use the same plan and priority as you or higher.*
  • Number of nodes assigned to your job – determined by the priority/plan you chose and the availability of nodes – a current farm load dictates how many nodes are available for use at any given time.*
  • Technical issues – Sometimes a farm’s system needs to be adjusted or reconfigured depending on a pipeline. In such case, the time it takes for the support team to respond comes into play.

*does not apply to server rental models and the like

TIP

It’s good to keep your project tidy, especially if you are going to render it on a different computer. You can use the ‘project folder’ option which is offered by all 3D applications. If you work with a custom pipeline, make sure that your scene doesn’t have missing assets, or paths that are too long.

Cost calculators are good tools for getting a very rough estimate of the cost of rendering, but they should be treated as an initial benchmark for the render farm cost for your project.

Cost Calculators do not take into consideration factors like a project’s loading time, troublesome frames that need re-rendering or the time needed to calculate a GI cache, among other things. This is why render farms often put a disclaimer next to their calculators, indicating that the final price can be somewhat higher or lower.

To understand more let’s have a look at how an online render farm works.

Building a render farm needs quite a lot of work. Not only at the stage of piecing all the parts together but also during maintenance.

3. Online render farm models

Online render farms are big sets of fast servers and nodes with fast internet connection.

They are put together from new models of computers to maximize speed and optimize electricity usage. However, farms don’t need to upgrade all their nodes to the latest cutting edge technology every month. The power of an online render farm lies in the scalability and parallelism in network rendering.

Nowadays, you can render a project on the cloud in a number of ways:

  1. Cloud rendering service, in which you get easy access to software you use to render your frames over multiple nodes. This model is more or less automated and the render farm provides not only the data storage and computing power but also takes care of the licensing costs for your 3d rendering software on its infrastructure. This kind of service is usually all-inclusive, which means that you pay only for the volume of rendered data with no additional fees for software setup, support and tools provided by the farm.
  2. Cooperative distributed rendering system, in which each node is another person’s computer he or she has volunteered to help render your job in the hopes that you would do the same later on.
  3. Server Rental, in which you are given remote access to a powerful server, where you can work just as you would on your home or studio computer.
  4. IaaS (infrastructure as a service) – in this model the cloud service provides you resources like computing power and data storage which you can scale according to your needs. The software installation ( including operating system ), configuration and rendering pipeline setting remains on your end.

All options have their advantages and disadvantages:

Cloud rendering service

  • On demand
  • Rendering on a large number of nodes
  • Usually the rendering system is automated
  • Usually comes with plugins for scene preparation and upload for supported software
  • Simple and convenient management of jobs, projects, cost, and tracking

Cooperative rendering:

  • Free to use ( you pay back by sharing your rendering power with other users )
  • Community based
  • Low data security
  • Difficulty in estimating rendering time
  • Difficulty in troubleshooting issues
  • No guarantee that all computers will meet the hardware requirements of your scene

Server rental

  • Manual setup
  • You can work on the project the way you want
  • Possible quick tests and tweaks of your scene without the need to reupload the project
  • You see the progress of rendering in real time ( statistics, frame buffer )
  • You project doesn’t wait for rendering – nobody jumps into the queue before you, so you can start rendering from the moment you log in to the server.
  • Your scene is not modified by a farm’s tools to work with its distributed rendering system – potentially less issues in rendering and faster troubleshooting
  • Possible rendering of rarely used, customized or obsolete software

IaaS – Infrastructure as a service

  • Highly customizable and scalable
  • Large volume of available resources ( computing power and data storage )
  • Good solution for big studios with large projects which need a custom solution
  • Possible rendering of rarely used, customized or obsolete software
  • Needs advanced technical team on studio’s end to create and manage the pipeline
  • Time consuming configuration

A cloud render farm service model is the more popular option because of the level of automation and the availability of support. From a user’s point of view all projects go through a few stage process on cloud rendering as a service. Let’s take a closer look at what this service model entails.

4. An overview of a Cloud Rendering Service’s pipeline

Scene preparation and upload

Scene dependencies, like paths to external assets, need to be modified to match the farm’s system. Render farm plugins do this for you, and in some cases even provide render presets for specific scenarios that would require a different render setting for network rendering than what you’ve prepared for your local machine

After initial preparation, the scene is uploaded to a farm using a plugin feature which works similarly to an FTP uploader.

TIP

It’s recommended to save the scene changes before using the plugin.

TIP

It’s recommended to run a test of a frame locally and keep it as a reference before uploading the new version of the scene to a farm. Always make sure that every new version of your scene renders fine on the farm by running a test, even if the correction is very small.

If the farm doesn’t use a plugin at this stage of the process, the projects ( scenes and all assets ) need to be prepared manually according to farm’s guidelines and uploaded by FTP or a similar tool.

Render farm data centers need to meet high security standards - against fire, flooding, overheating and to ensure air cleanliness.

Rendering and jobs management

After you upload your scene to a cloud render farm and launch your job, it gets sent to the farm’s node network by render management software. Depending on your project’s volume, it takes less or more time to load it to all cloud nodes. Render farms take care of this problem by optimizing their network for speed.

The management software then tells each node to load your scene on its respective 3d program. This part is also dependant on the scene’s size. As you probably noticed on your own computer, opening a scene in 3d software can sometimes take time. It doesn’t always depend only on the scene and asset volume though, every 3d program has its ‘style’.

This part of the rendering process is not taken into consideration by cost calculators. You can compare the rendering time by comparing the benchmarks, but only as far as the time between the start and end of rendering. Your scene’s loading time can differ from what you experience on your computer. In the case of remote servers, the scene is ready to render right after uploading, and you set up the rendering yourself, just as on your local computer.

No matter which cloud service you choose, the scene will be rendered on different types of computers and software environments than yours. 3d applications and render engines can use the processor’s features in a different way than your hardware setup does, so some random variation in render times may appear. It’s good to take it into consideration when you use online calculators.

NOTE

At this stage, many farms offer their users a job management system via a desktop application or a web interface. Through a render farm manager users can keep track of the rendering progress, change priorities/plans of rendering, terminate or pause rendering and use other management tools.

A typical cloud based distributed CPU rendering infrastructure hosts a number of nodes. The storage of all this hardware must involve a very efficient cooling system - both for individual nodes and the whole data centre.

Download

When frames are ready, they are downloaded to your computer via a farm’s download application, FTP or file sharing service.

5. Plan ahead

At this point, it’s clear that the process of rendering goes through quite a few stages. Even if the farm’s software is simple to use, there is a lot going on under the hood. A scene is taken from your pipeline and set on a farm’s computers. All render farms try to prepare a setup which will be as universal as possible, but they are still a different environment than from where your scene was created.

A render farm’s job is to save your time, but since it’s a very technical service it’s good to check some things ahead, so when you are in a hurry you can start rendering in no time.

The best way is to run a one frame test of your scene, and it doesn’t have to be the final version of the project. If you have an early version or just a scene which uses the same 3d software features, it will help you filter out potential problems and allow you and the farm make necessary tweaks, if they are needed (the final version will still need to be tested before final rendering though).

There are many benefits of doing early tests:

  • You will get accustomed to the render farm workflow and its tools.
  • You will see how your internet connection and company’s network restrictions work with the farm.
  • It will give the farm service provider time to prepare support of your 3d software or external plugins (if additional support or an up/downgrade is needed).
  • You will be able to check if your project renders the same as on your computer – sometimes little tweaks are necessary.
  • You will get a chance to work with the tech support team, see how responsive it is, and also give them a chance to get familiar with your pipeline and rendering needs.

Internet assets – missing paths, wrong shaders

If you are using assets downloaded from the internet, they can sometimes cause issues in rendering. Professional online shops like Evermotion create good, ready to render models, but if you are downloading from unconfirmed sources the models can have empty paths or shaders from different render engines which can cause issues during rendering. It’s good to make sure that the models have no paths pointing to non-existent textures or shaders from different render engines.

A render farm’s hardware is rarely updated all at once. That’s why they often use several types of nodes, with different speed, and bill accordingly to the node’s power.

Checking software support

All render farms are upfront about the 3d software they support, and they usually have a more or less detailed list on their websites.

However, the number of plugins and software builds used out there is so huge that you should double check if the farm can actually render with your specific version.

If you are still unsure, you should try contacting the support team, and ask if they support your exact version, especially if you are using some obscure, very old, or experimental builds. This will also allow you to check if the farm is ready to upgrade or downgrade their software for you, and on what terms. That also concerns any kind of customization of the render farm workflow should your pipeline need it.

Finally, a simple test won’t hurt :)

TIP

If you want to check with the farm whether they support your software version, it’s better to avoid saying ‘I have the latest version of the plugin.’ Sometimes render farm software versions are numbered in a different way than studio versions, plus a farm can have access to versions which are not yet released (or the opposite). All of that can lead to mistakes. That’s why you’ll always be better off providing the exact build of your software (not only the main version number).

Checking features & EULA

Before rendering on a render farm, you should pay particular attention to certain features and perhaps take a moment to check their User Agreement. It is usually displayed during the registration process. There are several topics that are especially important:

  • Data storage – Render farms cant keep your renders and projects forever, for that it would be good to look into cloud storage. It’s good to check how long your files will be kept on farm’s servers after the upload or completed rendering. Also check if there is any volume limitation or additional fees for using more volume for your stored data.
  • Render credits – Though unlikely, it is possible that some farms provide credits that expire after a certain period.
  • Refund policies – Render farms will have different policies regarding when your credits may be refunded to you, and whether monetary refunds are allowed.
  • Credit allocations for trial purposes – Most render farms offer a substantial amount of credits for new users. This is to allow first timers to test the service without needing to commit.
An online render farm works 24h/365. Ideally, customer support is accessible the same way.

NDA

Like any cloud service, all render farms protect their users’ data, and this is an important part of the User Agreement. If you need an additional guarantee, you can sign an NDA ( Non-Disclosure Agreement ) with a farm. If you don’t have your version of such an agreement, farms usually have their own template that you can use.

Volume discounts

If you are going to render a big project or you want to commit to the service long term, it’s good to check your farm’s discounts or other special incentives. Those can make cloud rendering much cheaper.

Payment methods, invoices

It’s good to check if the payment methods which are suitable for you are supported by farm. It might happen than certain kind of bank transfers or services like PayPal are forbidden in your country and the farm needs to come up with a different solution. That also includes invoicing for your payments.

Rendering on vacation – charity and personal projects

Some render farms support charity causes or run special programs for artists and studios by offering them their rendering services for free or just for electricity costs.

As with many businesses, rendering services also have periods of higher and lower traffic. Those are usually vacation periods, or at times right after important industry deadlines, like releasing seasonal holidays ads.

If you are not in a hurry with your personal project or want to ask for help with a charity video, these low seasons are a good time to ask. Farms have more idle nodes to share, and since queues are shorter, you can render on cheaper priorities without waiting too long.

6. Summary

The first contact with online renderfarms can be confusing. There are many services out there, with different workflows, but as with any CG tools, it just takes some testing and getting used to before you will use them with ease.

The first step is to check the software support and pricing. At this stage, you can compare pricing rates per Ghz or use a cost calculator, but the latter doesn’t take into account many factors which affect the final cost. I recommend treating the numbers they give with some reserve.

It’s good to test the water some time before uploading the final project for production rendering. Sending a test scene through the farm’s pipeline will filter out issues on every stage, and will make the process smooth when the deadline is nearing.

In the second part of this guide, we will show you proven testing techniques which give very close cost estimates and help to quickly detect possible problems. They are the real cost, time and stress savers, and I learned them working with hundreds of render farm customers.

To learn more about in-depth testing strategies go to Part 2.

Credits

This guide has been created by Michał Moś and edited with the help of the team at GarageFarm.NET. We derived most of the knowledge used in this guide from an extensive experience running a render farm for almost a decade.

Michał Moś ( aka ‘Andrew’ ) is part of GarageFarm.NET team specializing in 3d rendering topics from animation and troubleshooting to technical writing. He has worked for numerous design and architectural companies as a CG artist, designer, and instructor. Weapon of choice – 3ds Max, C4D, V-Ray and Octane. He loves drawing, creative writing, and tabletop RPGs.

https://michalmos.carbonmade.com
https://blog.garagefarm.net/

Related Posts

No items found.
live chat