Catalog PyPI
PACKAGE EXPLORERView in registry

academia-rl

PyPI

Easy-to-use tools for Curriculum Learning

curriculum-learningreinforcement-learning
Versions collected1
Direct dependencies7From release 0.2.0
Last observed20 Oct, 17:49 UTC

README

Version 0.2.0 documentation

academia

This package’s purpose is to provide easy-to-use tools for Curriculum Learning. It is a part of an engineering thesis at Warsaw University of Technology that touches on the topic of curriculum learning.

Documentation

https://academia.readthedocs.io/

Experiments

As a part of our engineering thesis, numerous experiments on Curriculum Learning have been conducted using this package. Their code and results can be found in a separate repo.

Sources

An unordered list of interesting books and papers

Books

  1. Reinforcement Learning: An Introduction (Barto, Sutton)

Papers

Paper LinkShort DescriptionRelated Papers
Curriculum Learning for Reinforcement Learning Domains: A Framework and SurveySurvey of curriculum learning papers. Formalises curriuclum learning based on a variety of attributes and gives a good introduction into the topic.
Curriculum Design for Machine Learners in Sequential Decision TasksTalks about curricula desgined by non-experts (i.e. people who do not know much/anything about a given domain). Uses "dog training" game as the basis of their experiments. Users can design a curriculum by sequencing any number of tasks in more or less complex environments. A target (more difficult) task is also provided to the user but they are not allowed to include it in the curriculum. A trainer model is used to go through the curriculum and provide feedback to the agent. They measure how good a curriculum is by the number of feedbacks that the trainer has to give to the agent i.e. if a curriculum is well designed the agent will require a relatively smaller number of feedbacks from the trainer to move on to the next task. They use three different trainer behaviours and show that the type of the trainer oes not influence the impact of curriuclum design i.e. if a curriculum is well designed under one trainer it is also well designed under another trainer. Another condition for a curriculum to be considered good is that the number of feedbacks over the entire curriculum (with the target task) should be smaller than the number of feedbacks when training on the target task alone. Results show that non-experts can design a better-than-random curriculum when it comes to reducing number of feedbacks on the target task alone but are not better-than-random in desigining a curriculum that decreases the overall number of feedbacks.Language and Policy Learning from Human-delivered Feedback,

Learning behaviors via human-delivered discrete feedback
Proximal Policy Optimization AlgorithmsNot directly related to Curriculum Learning but related to Reinforcement Learning.
A Deep Hierarchical Approach to Lifelong Learning in MinecraftHaven't read it yet, not directly connected to CL but should still be helpful

Downloads & popularity

Awaiting observations

No metric observations yet

Download counts and popularity will appear here as the collector receives them.

Versions 1

Collected releases
VersionPublishedDirect dependenciesOpen version
0.2.01 Oct 20247

Package advisories

0
No matching advisories collected

This describes our collected data; it is not a security assessment.

Repository

PENDING
krezelj/academia

Shared repository data · GitHub

License detected in repository
Not collected

Metadata history

Meaningful changes
Current collected state Current

Observed since 20 Oct, 17:49 UTC

No superseded metadata states collected. Unchanged observations do not create new revisions.

Record identity

package:d4ad60f7325584afc349a27dfc265661c7b3ce2c6a9e66a1b392a4bad0e96073