MineDojo is Out. Here is What You Need To Know.
Creating a generally capable, human-like AI is a massive challenge. MineDojo is here to help.
What is MineDojo?
MineDojo is a training environment for creating generally capable AI agents using a MineCraft game environment. MineDojo is created by NVIDIA and is open for everyone to develop generally capable AI agents.
Why MineCraft?
Training an AI is a highly data intensive task. That is exactly why game environments provide almost the perfect environment for training AI models. Game environments provide a well defined simulation environments for the AI to train, what’s more is that they can get really realistic and the AI can play the game by itself thousands of times within a day, depending on the game.
Just having a game, does not make it perfect though. In this case for example, there are thousands of actions a user can perform within MineCraft. At this point you may wonder, how would you teach an AI what actions corresponds to which moves in the game?
This is where the internet-scale training data comes into play. People do not just play MineCraft by themselves. They share it. There are over 730K YouTube videos containing 300K hours of gameplay. When transcribed this amount equals to 2.2Billion words you can match with video frames. This is a massive amount of data to train your Artificially Intelligent agent.
The main focus of MineDojo is not just to have an AI that can play MineCraft by itself. But instead it is to create an AI that can perform over thousands of tasks when we ask for them, either vocally or via text based prompt. This prompt can be as simple as “put carpets on the floor” or “scoop a bucket of lava” to more abstract tasks such as “build crop farms”. These tasks although vastly varying in complexity are classified into two main categories. First category is “programmatic tasks” and the second category is “creative…
