Skip to content
@xlang-ai

XLANG Lab

Developing embodied AI agents that empower users to use language to interact with digital and physical environments to carry out real-world tasks.

Welcome to the Executable Language Grounding (XLANG) Lab! We are part of the HKU NLP Group at the University of Hong Kong. XLang focuses on building language model agents that transform (“grounding”) language instructions into code or actions executable in real-world environments, including databases (data agent), web applications (plugins/web agent), and the physical world (robotic agent) etc,. It lies at the heart of language model agents or natural language interfaces that can interact with and learn from these real-world environments to facilitate human interaction with data analysis, web applications, and robotic instruction through conversation. Recent advances in XLang incorporate techniques such as LLM + external tools, code generation, semantic parsing, and dialog or interactive systems.

Pinned Loading

  1. OpenCUA OpenCUA Public

    OpenCUA: Open Foundations for Computer-Use Agents

    Python 713 92

  2. OSWorld OSWorld Public

    [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

    Python 2.7k 412

  3. aguvis aguvis Public

    [ICML2025] Aguvis: Unified Pure Vision Agents for Autonomous GUI Interaction

    Python 383 27

  4. OpenAgents OpenAgents Public

    [COLM 2024] OpenAgents: An Open Platform for Language Agents in the Wild

    Python 4.7k 522

  5. Spider2 Spider2 Public

    [ICLR 2025 Oral] Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows

    HTML 752 124

  6. instructor-embedding instructor-embedding Public

    [ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings

    Python 2k 156

Repositories

Showing 10 of 26 repositories
  • OSWorld Public

    [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

    xlang-ai/OSWorld’s past year of commit activity
    Python 2,675 Apache-2.0 412 138 4 Updated Mar 15, 2026
  • computer-agent-arena Public

    [ICLR 2026] Computer Agent Arena: Toward Human-Centric Evaluation and Analysis of Computer-Use Agents

    xlang-ai/computer-agent-arena’s past year of commit activity
    HTML 58 4 1 0 Updated Feb 26, 2026
  • OpenCUA Public

    OpenCUA: Open Foundations for Computer-Use Agents

    xlang-ai/OpenCUA’s past year of commit activity
    Python 713 MIT 92 15 0 Updated Feb 4, 2026
  • Spider2 Public

    [ICLR 2025 Oral] Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows

    xlang-ai/Spider2’s past year of commit activity
    HTML 752 MIT 124 91 5 Updated Jan 30, 2026
  • OSWorld-G Public

    [NeurIPS 2025 Spotlight] Scaling Computer-Use Grounding via UI Decomposition and Synthesis

    xlang-ai/OSWorld-G’s past year of commit activity
    TypeScript 156 6 10 1 Updated Nov 6, 2025
  • VideoAgentTrek Public

    The official repo of VideoAgentTrek

    xlang-ai/VideoAgentTrek’s past year of commit activity
    Python 46 MIT 3 1 0 Updated Oct 24, 2025
  • xlang-ai.github.io Public

    The official website of xlang.ai

    xlang-ai/xlang-ai.github.io’s past year of commit activity
    TypeScript 3 0 0 0 Updated Sep 27, 2025
  • BRIGHT Public

    [ICLR 2025] BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval

    xlang-ai/BRIGHT’s past year of commit activity
    Python 194 CC-BY-4.0 25 8 0 Updated Sep 13, 2025
  • AgentNetTool Public

    This is the official code base of AgentNetTool in OpenCUA. Website: https://opencua.xlang.ai/

    xlang-ai/AgentNetTool’s past year of commit activity
    TypeScript 39 MIT 11 1 0 Updated Sep 3, 2025
  • aguvis Public

    [ICML2025] Aguvis: Unified Pure Vision Agents for Autonomous GUI Interaction

    xlang-ai/aguvis’s past year of commit activity
    Python 383 27 24 0 Updated Mar 7, 2025

Most used topics

Loading…