PkgFoundry
Catalog PyPI
Back to packageRELEASE DETAILS

0.2.93

PyPI

agentdesk_dg

A desktop for AI agents

Published26 Aug 2024
Direct dependencies22
Transitive dependenciesNot calculated

README

Version 0.2.93 documentation

AgentDesk

Desktops for AI agents   :computer:
Explore the docs »

View Demo · Report Bug · Request Feature


AgentDesk provides full-featured desktop environments which can be programatically controlled by AI agents. Spin them up locally or in the cloud.

▶ Built on agentd a runtime daemon which exposes a REST API for interacting with the desktop.

▶ Implements the DeviceBay Protocol.

Installation

pip install agentdesk

Quick Start

from agentdesk import Desktop

# Create a local VM
desktop = Desktop.local()

# Launch the UI for it
desktop.view(background=True)

# Open a browser to Google
desktop.open_url("https://google.com")

# Take actions on the desktop
desktop.move_mouse(500, 500)
desktop.click()
img = desktop.take_screenshot()

Usage

Create a local desktop

from agentdesk import Desktop

desktop = Desktop.local()

$ agentdesk create --provider qemu

*requires qemu

Create a remote desktop on GCE

desktop = Desktop.gce()

$ agentdesk create --provider gce

Create a remote desktop on EC2

desktop = Desktop.ec2()

$ agentdesk create --provider ec2

View the desktop in the UI

desktop.view()

$ agentdesk view old_mckinny

*requires docker

List desktops

Desktop.find()

$ agentdesk get

Delete a desktop

Desktop.delete("old_mckinny")

$ agentdesk delete old_mckinny

Use the desktop

desktop.open_url("https://google.com")

coords = desktop.mouse_coordinates()

desktop.move_mouse(500, 500)

desktop.click()

desktop.type_text("What kind of ducks are in Canada?")

desktop.press_key('Enter')

desktop.scroll()

img = desktop.take_screenshot()

Processors

Process images to make them more accessible to LMMs.

Grid

Add a coordinate grid on top of the image

from agentdesk.processors import GridProcessor

img = desktop.take_screenshot()

processor = GridProcessor()
grid_img = processor.process_b64(img)

Examples

Drawing Bot

See how to use a web-based drawing app with AgentDesk in our notebook.

GPT-4V

See how to use GPT-4V with AgentDesk in our notebook or agent.

Community

Come join us on Discord.

Developing

Please open an issue before creating a PR.

Changes to the VM happen in agentd.

Downloads & popularity

Awaiting observations

No metric observations yet

Download counts and popularity will appear here as the collector receives them.

Declared dependencies 22

Native requirements
22 direct targetsNot calculated transitive count
Package / targetRequirementRelationship
pillow
Environment
{
  "extras": "",
  "marker": null,
  "requires_python": "<4.0,>=3.10",
  "evaluation": "NOT_EVALUATED"
}
pillow<11.0.0,>=10.2.0runtime
requests
Environment
{
  "extras": "",
  "marker": null,
  "requires_python": "<4.0,>=3.10",
  "evaluation": "NOT_EVALUATED"
}
requests<3.0.0,>=2.31.0runtime
fastapi
Environment
{
  "extras": "all",
  "marker": null,
  "requires_python": "<4.0,>=3.10",
  "evaluation": "NOT_EVALUATED"
}
fastapi[all]<0.110.0,>=0.109.0runtime
sqlalchemy
Environment
{
  "extras": "",
  "marker": null,
  "requires_python": "<4.0,>=3.10",
  "evaluation": "NOT_EVALUATED"
}
sqlalchemy<3.0.0,>=2.0.25runtime
psycopg2-binary
Environment
{
  "extras": "",
  "marker": null,
  "requires_python": "<4.0,>=3.10",
  "evaluation": "NOT_EVALUATED"
}
psycopg2-binary<3.0.0,>=2.9.9runtime
psutil
Environment
{
  "extras": "",
  "marker": null,
  "requires_python": "<4.0,>=3.10",
  "evaluation": "NOT_EVALUATED"
}
psutil<6.0.0,>=5.9.8runtime
docker
Environment
{
  "extras": "",
  "marker": null,
  "requires_python": "<4.0,>=3.10",
  "evaluation": "NOT_EVALUATED"
}
docker<8.0.0,>=7.0.0runtime
pycdlib
Environment
{
  "extras": "",
  "marker": null,
  "requires_python": "<4.0,>=3.10",
  "evaluation": "NOT_EVALUATED"
}
pycdlib<2.0.0,>=1.14.0runtime
namesgenerator
Environment
{
  "extras": "",
  "marker": null,
  "requires_python": "<4.0,>=3.10",
  "evaluation": "NOT_EVALUATED"
}
namesgenerator<0.4,>=0.3runtime
paramiko
Environment
{
  "extras": "",
  "marker": null,
  "requires_python": "<4.0,>=3.10",
  "evaluation": "NOT_EVALUATED"
}
paramiko<4.0.0,>=3.4.0runtime
typer
Environment
{
  "extras": "",
  "marker": null,
  "requires_python": "<4.0,>=3.10",
  "evaluation": "NOT_EVALUATED"
}
typer<0.10.0,>=0.9.0runtime
tabulate
Environment
{
  "extras": "",
  "marker": null,
  "requires_python": "<4.0,>=3.10",
  "evaluation": "NOT_EVALUATED"
}
tabulate<0.10.0,>=0.9.0runtime
tqdm
Environment
{
  "extras": "",
  "marker": null,
  "requires_python": "<4.0,>=3.10",
  "evaluation": "NOT_EVALUATED"
}
tqdm<5.0.0,>=4.66.2runtime
tenacity
Environment
{
  "extras": "",
  "marker": null,
  "requires_python": "<4.0,>=3.10",
  "evaluation": "NOT_EVALUATED"
}
tenacity<9.0.0,>=8.2.3runtime
google-cloud-storage
Environment
{
  "extras": "",
  "marker": null,
  "requires_python": "<4.0,>=3.10",
  "evaluation": "NOT_EVALUATED"
}
google-cloud-storage<3.0.0,>=2.14.0runtime
google-cloud-compute
Environment
{
  "extras": "",
  "marker": null,
  "requires_python": "<4.0,>=3.10",
  "evaluation": "NOT_EVALUATED"
}
google-cloud-compute<2.0.0,>=1.15.0runtime
google-cloud-container
Environment
{
  "extras": "",
  "marker": null,
  "requires_python": "<4.0,>=3.10",
  "evaluation": "NOT_EVALUATED"
}
google-cloud-container<3.0.0,>=2.38.0runtime
boto3
Environment
{
  "extras": "",
  "marker": null,
  "requires_python": "<4.0,>=3.10",
  "evaluation": "NOT_EVALUATED"
}
boto3<2.0.0,>=1.34.28runtime
boto3-stubs
Environment
{
  "extras": "ec2",
  "marker": null,
  "requires_python": "<4.0,>=3.10",
  "evaluation": "NOT_EVALUATED"
}
boto3-stubs[ec2]<2.0.0,>=1.34.28runtime
mypy-boto3-ec2
Environment
{
  "extras": "",
  "marker": null,
  "requires_python": "<4.0,>=3.10",
  "evaluation": "NOT_EVALUATED"
}
mypy-boto3-ec2<2.0.0,>=1.34.52runtime
toolfuse
Environment
{
  "extras": "",
  "marker": null,
  "requires_python": "<4.0,>=3.10",
  "evaluation": "NOT_EVALUATED"
}
toolfuse<0.2.0,>=0.1.13runtime
devicebay
Environment
{
  "extras": "",
  "marker": null,
  "requires_python": "<4.0,>=3.10",
  "evaluation": "NOT_EVALUATED"
}
devicebay<0.2.0,>=0.1.24runtime

Distribution files

2 collected
agentdesk_dg-0.2.93-py3-none-any.whl

bdist_wheel · 42.09 KB · Python py3

Source file
agentdesk_dg-0.2.93.tar.gz

sdist · 34.07 KB · Python source

Source file

Metadata history

Meaningful changes
Current collected state Current

Observed since 20 Oct, 21:48 UTC

No superseded metadata states collected. Unchanged observations do not create new revisions.

Record identity

package_version:857d07ce92a82db654a8faef398d9e148605e33de64e7f84b2fb4bf6098433f3

Other collected versions

View all collected versions →