All Notes

Published

Monday, January 13, 2025

Emergent Languages in a Nutshell

Emergent Languages - A Desiderata
In this space I want to collect a desiderata for emergent languages. Following (Skyrms2010signals?) and others my view of emergent languages is through the lens of minimal…
Oren Bochman
Tuesday, January 14, 2025
 
ad hoc complex signaling systems
Rather them consider how complex signaling systems evolve from a lewis signaling game plus some modifications it might be worth while to better understand some complex…
Oren Bochman
Monday, January 13, 2025
 
emergent complex communications protocols
it seems that we might want to look at the emergent communications by considering 1. a Lewis signaling games to model coordination tasks for a basic communication system 2.…
Oren Bochman
Monday, January 13, 2025

Complete pooling

Complete pooling

Complete pooling
Oren Bochman
Monday, January 13, 2025

Extensive form 3 x 3 Lewis signaling game

lewis game
Here the two information sets linking s_1 instances and s_2 instances indicate that the receiver cannot distinguish between the two states.
Oren Bochman
Monday, January 13, 2025

Bayesian Gaussian mixture model

Bayesian Gaussian mixture model
this is a chart from https://en.wikipedia.org/wiki/File:Bayesian-gaussian-mixture-vb.svg by https://en.wikipedia.org/wiki/User:Benwing
Oren Bochman
Monday, January 13, 2025

Roth Erev learning in Lewis signaling games
I wish now to implement learning in the Lewis signaling game. In the book some reinforcement learning RL algorithms are presented in some detail and a few variations are…
Oren Bochman
Monday, January 13, 2025
 
logic puzzles
Solve this logic puzzle step by step:
Oren Bochman
Monday, January 13, 2025
 
replay buffer questions
we should aim to keep full options traces in the buffer
Oren Bochman
Monday, January 13, 2025
 
deduction evaluation
goal create a deduction data-set for evaluating reasoning capabilities of a man and machine.
Oren Bochman
Monday, January 13, 2025
 
LLM the good the bad and the ugly
Early when I saw the first text by gpt2 I was intrigued that some of the researchers that did not get access to the early model and had to re-create the model based on just…
Oren Bochman
Monday, January 13, 2025
 
Fine-tune llm for Style and Grammar advice.
Question 1: LLM are amazing - can I fine tune a state of the art LLM like Lama 3.1 with what I consider to be very high quality writing from my private library content to…
Oren Bochman
Monday, January 13, 2025
 
NLP with RL
supervised and unsupervised models are great for most NLP tasks, yet both approaches have their limitations. Supervised models require labeled data, which is usually in…
Oren Bochman
Monday, January 13, 2025
 
LLM and the missing link
The missing link is my name for a set of agents that should be able to edit wikipedia or at least to significantly reduce the effort needed to contribute to wikipedia.
Oren Bochman
Monday, January 13, 2025

Misbehaviour of Markets and Scaling in financial prices 1-4
One of the most popular books for quants is “The (Mis)behaviour of Markets” (Mandelbrot and Hudson 2010). This is more a popular science book than a technical tome with…
Oren Bochman
Monday, January 13, 2025

Scaling in financial prices 1
“The ideal market completely disregards those spikes—but a realistic model cannot.”
Oren Bochman
Monday, January 13, 2025

Scaling in financial prices 2
In the paper “Scaling in financial prices: II. Multifractals and the star equation” (Mandelbrot 2001) Mandelbrot continus his exploration of financial price scaling. He…
Oren Bochman
Monday, January 13, 2025

Scaling in financial prices 3
In the paper “Scaling in financial prices: III. Cartoon Brownian Motions in Multifractal Time” (Mandelbrot 2001) Mandelbrot continus his exploration of fractal and…
Oren Bochman
Monday, January 13, 2025

Scaling in financial prices 4
“In the Brownian model, such a high level of concentration has a probability so minute that it should never happen. Unfortunately for the model, it happens every decade.”
Oren Bochman
Monday, January 13, 2025
 
Sine function
The plot below allows you to control parameters used in the sine function. Experiment with the period, amplitude, and phase shift to see how they affect the graph.
Oren Bochman
Monday, January 13, 2025

Complete pooling

tikz in Quarto!

Complete pooling
Oren Bochman
Monday, January 13, 2025
 
RL MindMap 

mindmap
  root((RL))
    Main Concepts
        [MDP]
          Continuing Tasks
          Episodic Tasks
          Markov Property
        [Reward]
        [Action…

Oren Bochman
Monday, January 13, 2025
 
gradio local model 
import gradio as gr
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer, StoppingCriteria, StoppingCriteriaList, TextIteratorStreamer
from threading im…
Oren Bochman
Monday, January 13, 2025

A garden of forking paths
couple of things
Oren Bochman
Saturday, January 11, 2025
 
Research Notes
Question: how can we use planning in the Lewis Signaling Game.
Oren Bochman
Monday, January 6, 2025

lewis signaling game

The Many Path To A Signaling System
While reviewing the literature on lewis games and thier extensions I realized that there are a many ways that signaling systems can arise. Ofttimes people make assumption…
Oren Bochman
Sunday, January 5, 2025
 
Off-Policy Learning
RL is full of big words like “off-policy learning” and “importance sampling”. If big words scare you, you are not alone. But most of the ideas in RL are simple and…
Oren Bochman
Saturday, January 4, 2025

Rethinking Signaling systems via the lens of compositionality
I was introduced to the subject of language evolution by Brian Skryms in his book “Signals: Evolution, Learning, and Information” where he discusses the evolution of…
Oren Bochman
Thursday, January 2, 2025
 
Lewis Signaling Game for PettingZoo
The above is a basic version of the Lewis Signaling Game implemented in PettingZoo. The game consists of a sender and one or more receivers.
Oren Bochman
Wednesday, January 1, 2025

Linguistic generalization and compositionality in modern artificial neural networks
In (Baroni 2020) the author discusses the role of deep artificial neural networks in natural language processing tasks and their generalization abilities. The paper reviews…
Oren Bochman
Wednesday, January 1, 2025

Compositionality and Generalization in Emergent Languages
Very exciting - this is a paper with a lot of interesting ideas. It comes with a a lot of code in the form of a library called EGG as well as many JuPyteR notebooks. There…
Oren Bochman
Wednesday, January 1, 2025

Emergence of Linguistic Communication from Referential Games with Symbolic and Pixel Input
This is the paper that Marco Baroni used to explain the emergence of languages in his talk “Is Composonality over rated?”.
Oren Bochman
Wednesday, January 1, 2025

Vitter Algorithm
This is the vitter algorithm - an algorithm for encoding and decoding messages using Huffman codes.
Oren Bochman
Wednesday, January 1, 2025

Books, Courses Tools
An Introduction to Statistical Learning by Gareth James, Daniela Witten, Trevor Hastie and Robert Tibshirani.
Oren Bochman
Wednesday, January 1, 2025

Villeny pure and simple
So much has been written about capone, and gangster movies here is a little note on character building in Noir. Noir characters were often minmal stereotypes, but some…
Oren Bochman
Thursday, December 12, 2024

Compositionality in Lewis signaling games and MARL transfer learning.
Compositionality means different things to different people in different contexts, which is irksome to the student, renders researches prone to vagaries and foist unexpected…
Oren Bochman
Monday, October 14, 2024

TL-DR rethinking 💭 topological alignment
Recently, I’ve been revisiting an old idea about creating a topological model of alignment. The machine translation task has been solved largely by using deep learning…
Oren Bochman
Tuesday, October 1, 2024

Compositionality in a nutshell

Is compositionality overrated? The view from language emergence
I came across this talk during my ongoing research into complex signaling systems. My point of view is one in which extends the work in (Skyrms 2010). My notion is to…
Oren Bochman
Sunday, September 1, 2024
 
Six quick tips to improve modeling
The following tips are from (Gelman and Hill 2007) Data Analysis Using Regression and Multilevel/Hierarchical Models by Andrew Gelman and Jennifer Hill.
Oren Bochman
Monday, August 26, 2024
 
Stumpy
Stumpy (Law 2019) is a powerful and scalable library for computing a matrix profile which can be used for a variety of time series data mining tasks.
Oren Bochman
Thursday, August 8, 2024
 
two ideas on generelization
the first idea comes from looking at regression and hyperparameter optimization tasks
Oren Bochman
Monday, July 1, 2024
 
mesa & rl
Ifs we can store state, action, reward trajectories (to a file) this would facilitate
Oren Bochman
Tuesday, June 25, 2024
 
zero inflated data
Zero inflated data is a type of data that has a large number of zero values.
Oren Bochman
Sunday, June 23, 2024
 
readings in rl
A list of RL-papers and resources that I have read or plan to read.
Oren Bochman
Tuesday, June 18, 2024
 
Hyperparameter Optimization
one the idea is for a set of Hyperparameters to find the best one.
Oren Bochman
Thursday, June 13, 2024
 
Multi-agent Reinforcement Learning in Sequential Social Dilemmas
Matrix games like Prisoner’s Dilemma have guided research on social dilemmas for decades. However, they necessarily treat the choice to cooperate or defect as an atomic…
Oren Bochman
Monday, June 10, 2024
 
Generally Capable Agents Emerge from Open-Ended Play
The paper does not present a breakthrough like alpha go zero etc. But it shows very high level of creativity and innovation. I am still a new comer to RL and this paper has…
Oren Bochman
Monday, June 10, 2024
 
Semantic Kernel 
import semantic_kernel as sk
from semantic_kernel.connectors.ai.open_ai import AzureChatCompletion, OpenAIChatCompletion
import semantic_kernel.ai.open_ai as sk_oai


kernel =…
Oren Bochman
Saturday, June 8, 2024

Evolutionary Games and Population Dynamics Summary
I’ve recently come across a book called “Evolutionary Games and Population Dynamics” by Josef Hofbauer and Karl Sigmund.
Oren Bochman
Sunday, May 12, 2024

Urn models using Numpy
Let’s create one of the most fundumental models in probability theory - the urn model.
Oren Bochman
Thursday, May 2, 2024
 
RAD REPL
TODO: 1. [x] basic REPL 2. [x] command based class 3. [x] add task command 4. [x] list tasks command 5. [x] set current task command 6. [x] complete task command
Oren Bochman
Wednesday, May 1, 2024
 
Signals Experiment
some refactoring ideas:
Oren Bochman
Wednesday, May 1, 2024
 
Skryms Signals Summary Bibliography
Skryms briliant mind kept all these tidbits of information in his head but many were not as important for exploring what seemed to be the main thrust of the book which was a…
Oren Bochman
Wednesday, May 1, 2024

Skryms Signals Summary and Models
In (Skyrms 2010) philosopher and mathematician Brian Skyrms discusses how one can extend the concept of a signaling games into a full fledged signaling systems and to some…
Oren Bochman
Wednesday, May 1, 2024
 
Mesa Lessons
Implementing Sugarscape has some interesting lessons.
Oren Bochman
Sunday, March 31, 2024
 
OCR building blocks
split into:
Oren Bochman
Thursday, March 28, 2024

Patric Winston

A definition by Patrick Henry Winston
Patrick Henry Winston provides a definition of AI. How he keeps expanding his definition as he goes along is thing of beauty. It expands organicaly to incorporate new ideas…
Oren Bochman
Sunday, March 3, 2024
 
OCR - Brain Dump
Working of OCR articles by Susmith Reddy
Oren Bochman
Sunday, February 25, 2024

Rhetoric NLP Tasks
I recently have been annotating speeches following up on the edx a course on Rhetoric.
Oren Bochman
Saturday, February 17, 2024

mermaid logo

😁 Quarto 💖 Mermaid🧜 Mindmaps 🧠
Quarto at last supports Mindmap charts using Mermaid charts.
Oren Bochman
Monday, February 12, 2024
 
Lewis Game from a Bayesian Perspective
I have been thinking about Lewis Signaling games recently, and I had come up with a couple of questions that I wanted to answer.
Oren Bochman
Monday, February 12, 2024

man standing beside pipes by Kaique Rocha

The Great Migration
some migration notes from Blooger to Jekyl to Quarto blog.
Oren Bochman
Tuesday, January 30, 2024

Post With Code
This is an obligatory post with executable code.
Oren Bochman
Sunday, January 28, 2024

Card image cap

Quarto 💖 Bootstrap 😁
Thus it is possible to pop bootstrap css into divs and spans and get formatting using bootstrap.
Oren Bochman
Saturday, January 20, 2024

SuperLearner
SuperLearner is an ensambeleing library.
Oren Bochman
Wednesday, January 10, 2024
 
Engineering Reinforcement Learning Algorithms
As I progressed though the RL specialization I came to realize that the research is mostly about coming up with a new algorithm that works better. This is tricky and so in…
Oren Bochman
Wednesday, January 10, 2024

Emergent Languages In a Nutshell

Understanding Emergent Languages
Okay after taking a break, today I’ve been rethinking Complex Lewis signaling systems and the equilibria. I slow make progress in this area byc considering a number of…
Oren Bochman
Thursday, January 4, 2024

D3.js in in Quarto Observable
So I’ve migrated my sample to Quarto – which supports d3.js via Observable and without the need for whack hacks
Oren Bochman
Tuesday, January 2, 2024

AutoGluon Cheetsheets
Autogluon is a auto-ml framework, here are three cheetsheet for accellerating data science workloads
Oren Bochman
Wednesday, December 20, 2023
 
Summary: Synthesis and Stabilization of Complex Behaviors through Online Trajectory Optimization
This paper was referenced by Drew Bagnell in the Coursera RL specilization for using simple quadratic approximation to learn a model in a continous control setting. The…
Oren Bochman
Thursday, June 1, 2023
 
Spark Tips
https://stackoverflow.com/questions/30245180/what-do-the-numbers-on-the-progress-bar-mean-in-spark-shell#:~:text=This%20progress%20indicator%20means%20that,number%20of%20task…
Oren Bochman
Thursday, June 1, 2023
 
MCMC algorithms
The procedure MetropolisHastings takes as input : - the target distribution p(x), - the proposal distribution q(x,y), - the initial sample x_0, and - the total number of…
Oren Bochman
Saturday, April 22, 2023
 
Quarto loves pseudocode
\begin{algorithm} \caption{Quicksort} \begin{algorithmic} \Procedure{Quicksort}{$A, p, r$} \If{$p < r$} \State $q = $ \Call{Partition}{$A, p, r$} \State…
Oren Bochman
Tuesday, April 11, 2023

slide

Text2topic Leverage reviews data for multi-label topics classification in Booking.com
Having millions of customer reviews, we would like to better understand them and leverage this data for different use cases. For example, finding popular activities per…
Oren Bochman
Tuesday, February 28, 2023

slide

Validating NLP data and models
NLP data, and unstructured data in general, is very hard to validate. Validating NLP data is a real challenge, as actions such as statistical analysis and segmentation…
Oren Bochman
Tuesday, February 28, 2023
 
Transformations in Linguistic Representation
In computational linguistics, using different representations can shed light on the structure of language. I’m considering how sentences can be depicted using parse trees or…
Oren Bochman
Wednesday, February 22, 2023
 
event generator
fake data
Oren Bochman
Thursday, February 16, 2023

OLS regression From Scratch
OLS regression is a method for estimating the parameters of a linear regression model. The goal is to find the line that best fits a set of data points. The line is…
Oren Bochman
Wednesday, February 1, 2023
 
entropy for uncertainty quantification
There is an e-commerce store. Every day it collects the cost, sales and shelf price for each product. Let’s say we also have to deduct a sales tax or value added tax say at…
Oren Bochman
Thursday, September 22, 2022

wikisym 2012 logo

Wikisym 2012
Due to a kind grant by the WikiMedia Foundation I was able to attend Wikisym 2012 in Linz Austria what follows is my report on the event.
Oren Bochman
Tuesday, July 26, 2022
 
Set Up M1 MacBooks for DS & ML
Set Up M1 MacBooks for DS & ML
Oren Bochman
Thursday, May 5, 2022
 
command line
command line cheea sheet macos + zsh + git
Oren Bochman
Thursday, May 5, 2022

Meme bank
A meme is an idea, behavior, style, or usage that spreads from person to person within a culture. A meme bank would be a zoo for cataloging and breeding memes.
Oren Bochman
Thursday, December 30, 2021

Excel 2019 for Marketing Statistics in pandas
Excel 2019 for Marketing Statistics in pandas
Oren Bochman
Friday, September 24, 2021

Language models and explainability
Language models and explainability
Oren Bochman
Friday, September 24, 2021

Attention for sensor fusion
Attention for sensor fusion
Oren Bochman
Friday, September 24, 2021

Storytelling and other essentials
Storytelling and other essentials,
Oren Bochman
Thursday, September 2, 2021

Stochastic Gradient Descent - The good parts
Stochastic Gradient Descent - The good parts
Oren Bochman
Sunday, August 29, 2021

WaveNet Review
The WaveNet paper is kind of old. Yet it seems to come up in various contexts. Some thoughts on this.
Oren Bochman
Sunday, August 29, 2021

Python Graphs
Python Graph Cookbook
Oren Bochman
Sunday, August 29, 2021

What is in a citation?
Creating Citation Web Components
Oren Bochman
Sunday, August 29, 2021

Hackathon session link dumps & notes
Wikipedia Hackathon notes
Oren Bochman
Friday, August 13, 2021

Inlining Citations for Wikipedia articles
An algorithm for Inlining Citations for Wikipedia articles.
Oren Bochman
Friday, August 13, 2021

Transfer learning in NLP
Transfer learning in NLP
Oren Bochman
Thursday, August 12, 2021

A type of Witness and an evolving Idiom
writing better code = writing more readable code.
Oren Bochman
Wednesday, July 14, 2021
 
json-ld
I’ve been excited about JSON-LD, when it came out as it offered a much cleaner way to do SEO. However It dawned on me later that it is also a geat format to worked with…
Oren Bochman
Thursday, July 1, 2021

TensorFlow probability
In a recent google ai blog post an transformer based autoencoder is shown that can be used to learn and generate document layouts.
Oren Bochman
Tuesday, June 1, 2021

Ebook Hacks
A number of djvu docs collected over a long time need to be convert them into pdf.
Oren Bochman
Saturday, May 29, 2021

Multilevel Models
Different Multilevel Models Types
Oren Bochman
Sunday, May 16, 2021

Q&A and the Winograd schemas
The classical Q&A task is fairly easy to solve. But how well does the IR system understand/model the data. The challenge to test this aspect of the system is to provide test…
Oren Bochman
Tuesday, April 27, 2021

Automatic Summarization Task
Concepts, slide commentaries and Lecture notes on Automatic text Summarization by Masa Nekic
Oren Bochman
Saturday, April 24, 2021

Bayesian agents
Let’s try to define a KR framework for a Bayesian agent.
Oren Bochman
Wednesday, April 14, 2021

Modeling Events
Modeling Events.
Oren Bochman
Friday, April 9, 2021

Language Models Are Open Knowledge Graphs
A review of the paper “Language Models are Open Knowledge Graphs” by Chenguang Wang, Xiao Liu, Dawn Song arXiv:2010.11967
Oren Bochman
Wednesday, April 7, 2021

Linkage 2021-04-07
Cleaning up my Tabs:
Oren Bochman
Wednesday, April 7, 2021

10 Tips To Improve Your Workflow
How to blog like a life-hacker.
Oren Bochman
Wednesday, April 7, 2021

Jekyll take 3
My attempts to get the jekyll version of this site to also build locally.
Oren Bochman
Sunday, April 4, 2021

MathJax 3 fix for Jekyll hosted on Github pages
Issues and workarounds for MatchJax 3.0.
Oren Bochman
Sunday, April 4, 2021

Effective Approaches to Attention-based NMT
Review of the paper on dot product attention for the deeplearning.ai NLP specialization.
Oren Bochman
Sunday, March 21, 2021

numpy melt down
numpy melt down.
Oren Bochman
Sunday, November 29, 2020

Deep Learning Intuitions
Stacking n-layers RELUS in a feed forward neural network is functionally equivalent to a set of nested inequalities.
Oren Bochman
Sunday, October 25, 2020
 
brace expansion
  • the bash shell supports brace expansion.
  • the idea is that the string before and after are concatenated with element in the braces
echo "you won "{two,three,four}"…
Oren Bochman
Friday, June 12, 2020

Pandas Productivity Challenge?
Just a little rant on Pandas various contexts
Oren Bochman
Wednesday, March 4, 2020

How to avoid cross site scripting (XSS) errors with the Jupyter local runtime for Colab
So the trick is
Oren Bochman
Thursday, February 20, 2020

Docker for data science
Post description
Oren Bochman
Sunday, November 24, 2019
 
Exploding and vanishing nodes.
One paradgm is that the network could be dynamic. For such a model we want to be able to add and remove nodes. This could be an issue for networks that are engineered to…

Oren Bochman
Wednesday, July 31, 2019

text annotation with BRAT
BRAT is a rapid annotation tool. Its old no long maintained - the original developers seem to have moved on. Requests for RTL support have been largely ignored. Some…
Oren Bochman
Tuesday, January 16, 2018

A/B testing cost and risks?
A/B testing cost and risks and some recommendation.
Oren Bochman
Sunday, July 30, 2017
 
Travel checklist
    • Oren Bochman
    Wednesday, December 14, 2016
     
    HotJar Heat Map Analysis - Dr. David Darmanin
    What are Heatmaps
    Oren Bochman
    Wednesday, April 20, 2016
     
    Using Competitive Analysis to Benchmark Your Marketing Efforts Ariel Rosenstein - Similar Web
    Mr Jerbi’s Background:       Come to web analytics from academia Industry and Management - Scheduling and QA.       Recalls that before it was bought by Google Urchin cost…
    Oren Bochman
    Monday, April 20, 2015
     
    Using Competitive Analysis to Benchmark Your Marketing Efforts - Ariel Rosenstein - Similar Web
    Ari is the Sr. Marketing Director at Similarweb
    Oren Bochman
    Monday, April 20, 2015
     
    Analytics Checklist
    Oren Bochman
    Saturday, February 7, 2015
     
    life hacks
    Health and supplements:
    Oren Bochman
    Friday, June 7, 2013

    Text Mining With Python
    processing unknown tokens
    Oren Bochman
    Tuesday, November 29, 2011

    Text Mining With R
    Computational Linguistics tasks:
    Oren Bochman
    Tuesday, November 29, 2011

    Tidy Text Mining With R
    Computational Linguistics tasks:
    Oren Bochman
    Tuesday, November 29, 2011

    Photo by Pixabay

    Time management Tips
    Effective time management is crucial for success in both personal and professional life. With the right approach, you can achieve more in less time while maintaining a…
    Oren Bochman
    Thursday, August 11, 2011
    No matching items