Discussion
Loading...

Post

Log in
  • About
  • Code of conduct
  • Privacy
  • About Bonfire
Andrew Graves :arch: :linux:
Andrew Graves :arch: :linux:
@graves501@fosstodon.org  ·  activity timestamp 5 days ago

I've randomly encountered this blog: https://peter-nhan.github.io/posts/Local-Android-Ollama/

You can run #Ollama models on your #Android phone via #termux - So basically run a Chatbot on your phone!

It works great on my old OnePlus Nord, but it's extremely slow or not working at all on my Pixel 9 Pro running #GrapheneOS - does anyone know how to fix this?

My Playground

Running Ollama locally on Android device

This is just the beginning. As mobile hardware continues to advance, and as open-source projects like Ollama mature and optimize for mobile architectures, the idea of having powerful, locally-run AI models in our pockets will become increasingly commonplace.
  • Copy link
  • Flag this post
  • Block
tranquil_cassowary
tranquil_cassowary
@tranquil_cassowary@infosec.exchange replied  ·  activity timestamp 4 days ago

@graves501
Have you tried doing it via the Terminal app available via developer options instead?

  • Copy link
  • Flag this comment
  • Block
Andrew Graves :arch: :linux:
Andrew Graves :arch: :linux:
@graves501@fosstodon.org replied  ·  activity timestamp 4 days ago

@tranquil_cassowary

Woah, since when do we have that option on Android? Can I still execute the termux ollama executable? Don't want to necessarily compile ollama on my phone if not necessary. Thanks for the input!

  • Copy link
  • Flag this comment
  • Block
tranquil_cassowary
tranquil_cassowary
@tranquil_cassowary@infosec.exchange replied  ·  activity timestamp 4 days ago

@graves501
It's just a Debian VM. So to install ollama models you'd need to use installation instructions that apply to Debian.

  • Copy link
  • Flag this comment
  • Block
Andrew Graves :arch: :linux:
Andrew Graves :arch: :linux:
@graves501@fosstodon.org replied  ·  activity timestamp 4 days ago

@tranquil_cassowary Really cool stuff, thanks!

  • Copy link
  • Flag this comment
  • Block

BT Free Social

BT Free is a non-profit organization founded by @ozoned@btfree.social . It's goal is for digital privacy rights, advocacy and consulting. This goal will be attained by hosting open platforms to allow others to seamlessly join the Fediverse on moderated instances or by helping others join the Fediverse.

BT Free Social: About · Code of conduct · Privacy ·
Bonfire social · 1.0.1 no JS en
Automatic federation enabled
Log in
  • Explore
  • About
  • Code of Conduct