Reinforcement Learning From Human Ratings

dc.contributor.advisorCao, Yongcan
dc.contributor.authorWhite, Devin
dc.contributor.committeeMemberJin, Yufang
dc.contributor.committeeMemberKudithipudi, Dhireesha
dc.date.accessioned2024-03-26T22:49:29Z
dc.date.available2024-03-26T22:49:29Z
dc.date.issued2023
dc.description.abstractReinforcement learning (RL), an important subject in artificial intelligence, focuses on learning control policies to tackle various tasks from Atari Games to autonomous driving and large language models. To derive control policies via RL, it is often required that reward functions are designed beforehand. Because reward functions, a map from states or state-action pairs to quantitative reward values, reflect both the task objectives and the underlying environments, it is often difficult and costly to design these reward functions. Instead of designing reward functions, an alternative approach is to learn reward functions from human guidance. In this thesis, we focus on developing a new rating-based reinforcement learning approach that uses human ratings to learn reward functions. Different from the existing human guidance methods, namely, preference-based and ranking-based reward learning paradigms which are based on human relative preferences over sample pairs, the proposed rating-based reinforcement learning approach is based on human evaluation of individual trajectories without relative comparisons between sample pairs. The rating-based reinforcement learning approach builds on a new prediction model for human ratings and a novel multi-class loss function to learn the reward functions, which are then used to learn RL-based control policies. We conduct experimental studies based on both synthetic ratings and real human ratings to evaluate the effectiveness and benefits of the new rating-based reinforcement learning approach.
dc.description.departmentElectrical and Computer Engineering
dc.format.extent1 electronic resource (43 pages)
dc.format.mimetypeapplication/pdf
dc.identifier.isbn9798381180664
dc.identifier.urihttps://hdl.handle.net/20.500.12588/6258
dc.languageeng
dc.subjectArtificial Intelligence
dc.subjectHuman Guided Reinforcement Learning
dc.subjectMachine Learning
dc.subjectReinforcement Learning
dc.subject.classificationArtificial intelligence
dc.subject.classificationComputer engineering
dc.subject.classificationComputer science
dc.titleReinforcement Learning From Human Ratings
dc.typeThesis
dc.type.dcmiText
thesis.degree.departmentElectrical and Computer Engineering
thesis.degree.grantorUniversity of Texas at San Antonio
thesis.degree.levelMasters
thesis.degree.nameMaster of Science

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
White - Thesis.pdf
Size:
1.42 MB
Format:
Adobe Portable Document Format