AgentBench logo
AgentBench
★ 3.8k
vs
Awesome-LLM-in-Social-Science logo
Awesome-LLM-in-Social-Science
★ 652

AgentBench vs Awesome-LLM-in-Social-Science

AgentBench: AgentBench is a comprehensive benchmark for evaluating Large Language Models (LLMs) as agents across diverse environments, now featuring a function-calling version integrated with AgentRL. It provides a containerized setup for various tasks like OS interaction, database operations, and web shopping, enabling robust and reproducible agent evaluation.; Awesome-LLM-in-Social-Science: This repository curates a comprehensive collection of papers focusing on the intersection of Large Language Models and Social Science. It covers evaluation, alignment, application, surveys, and datasets, with a special emphasis on Psychology and intrinsic values.

01

TL;DR

AgentBench logo
AgentBenchObservability · ★ 3.8k

Systematically benchmark the performance of various LLM-based agents.

Awesome-LLM-in-Social-Science logo
Awesome-LLM-in-Social-ScienceObservability · ★ 652

Evaluating LLM characteristics (e.g., values, personality, morality) from a social science perspective

02

Side-by-Side Comparison

Field
AgentBench logoAgentBench
Awesome-LLM-in-Social-Science logoAwesome-LLM-in-Social-Science
Category
Observability
Observability
Stars
★ 3.8k
★ 652
License
Apache-2.0
MIT
Install Command
pip install -r requirements.txt
git clone https://github.com/ValueByte-AI/Awesome-LLM-in-Social-Science.git
Updated
8mo ago
4w ago
Open Source
Yes
Yes
Tags
LLM Evaluation, Agent Benchmarking, Function Calling
Large Language Models, Social Science, Psychology
03

Features

AgentBench logoAgentBench
01Comprehensive LLM-as-Agent Evaluation across diverse environments.
02Function Calling integration for advanced agent interaction.
03Fully containerized deployment using Docker Compose for reproducibility.
04Multi-task and multi-turn interaction for realistic agent assessment.
05Extensible framework for adding new evaluation tasks.
Awesome-LLM-in-Social-Science logoAwesome-LLM-in-Social-Science
01Evaluation of LLMs from Social Science perspective
02Alignment of LLMs with Social Science principles
03Application of LLMs in Social Science research
04Comprehensive Surveys on LLM in Social Science
05Curated Datasets for LLM and Social Science studies
04

Use Cases

AgentBench logoAgentBench
↳Systematically benchmark the performance of various LLM-based agents.
↳Develop and refine advanced LLM agent architectures and strategies.
↳Conduct academic research on the capabilities and limitations of agentic AI.
Awesome-LLM-in-Social-Science logoAwesome-LLM-in-Social-Science
↳Evaluating LLM characteristics (e.g., values, personality, morality) from a social science perspective
↳Aligning LLMs with human values and societal norms
↳Facilitating social science research and problem-solving using LLMs
05

Best For

AgentBench logoAgentBench
Essential
Awesome-LLM-in-Social-Science logoAwesome-LLM-in-Social-Science
TrendingHidden Gem
FAQ

FAQ

What is the difference between AgentBench and Awesome-LLM-in-Social-Science?
Both AgentBench and Awesome-LLM-in-Social-Science are in the Observability category. AgentBench has 3.8k stars, while Awesome-LLM-in-Social-Science has 652 stars.
Which is better, AgentBench or Awesome-LLM-in-Social-Science?
The best choice depends on your use case. Choose AgentBench if Systematically benchmark the performance of various LLM-based agents., and Awesome-LLM-in-Social-Science if Evaluating LLM characteristics (e.g., values, personality, morality) from a social science perspective.
Is AgentBench free or open source?
Yes, AgentBench is open source on GitHub (Apache-2.0).
Is Awesome-LLM-in-Social-Science free or open source?
Yes, Awesome-LLM-in-Social-Science is open source on GitHub (MIT).
Cloud Infrastructure
Ad

Deploy on DigitalOcean

Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.

Claim $200 Free Credit
→

Related