Discussion
Loading...

Post

Log in
  • About
  • Code of conduct
  • Privacy
  • About Bonfire
Artyom Bologov
Artyom Bologov
@aartaka@merveilles.town  ·  activity timestamp 6 days ago

I still have to wrap my head around @screwlisp ‘s “deep learning in #Lisp” post <https://screwlisp.small-web.org/fundamental/a-better-deep-learning-algorithm/>, but I’m already hyped up:

• I we can do deep learning without numbers, only doing symbol/tree transformations

• And if there are systems that specialize on tree transformations and don’t have native numbers

• Then we can use these systems to do deep learning without actually needing any of the “modern” scaffolding for it!

Things that come to mind:

• @june@june@social.nouveau.community ‘s Modal and maybe Nova?

• @neauoire ‘s experiments with neural nets as embedded notepad connections

• ed(1) as a symbolic playground. C’mon, have you thought I’d go even one post without mentioning ed? Hell no! I’m going to understand this symbolic neural nets thing and start doing deep learning in ed! 🤩

  • Copy link
  • Flag this post
  • Block
screwlisp
screwlisp
@screwlisp@gamerplus.org replied  ·  activity timestamp 6 days ago

@aartaka
I had this feeling when I noticed I could just change +1 and -1 to foo and (complement foo) in a hopfield network, which is an implementation of (is dual to) deep learning (it turned out; they didn't know this originally).

Then, all the conventional wisdom about the disadvantages and advantages of deep learning seem to mostly have been artifacts of the string encoding being used.

@neauoire
what should I read about your connexions (or dare I say, neurons!)?

  • Copy link
  • Flag this comment
  • Block
Devine Lu Linvega
Devine Lu Linvega
@neauoire@merveilles.town replied  ·  activity timestamp 6 days ago

@screwlisp @aartaka I wrote about it a bit here: https://wiki.xxiivv.com/site/neural_nets.html

I realized that it could power a sort of "smart highlight" that runs the thoughts of program, a bit like livecoding, but it's only a work in progress at the moment:
https://www.youtube.com/watch?v=nIlwdTIbTIU
https://www.youtube.com/watch?v=b2Tg7RPBvew

This is all heavily inspired by Minski's work in Finite & Infinite Machines.

  • Copy link
  • Flag this comment
  • Block

BT Free Social

BT Free is a non-profit organization founded by @ozoned@btfree.social . It's goal is for digital privacy rights, advocacy and consulting. This goal will be attained by hosting open platforms to allow others to seamlessly join the Fediverse on moderated instances or by helping others join the Fediverse.

BT Free Social: About · Code of conduct · Privacy ·
Bonfire social · 1.0.1 no JS en
Automatic federation enabled
Log in
  • Explore
  • About
  • Code of Conduct