All Notes

The roles of Partial pooling and mixed strategies in the Lewis signaling game
Today I posit a couple of questions on the Lewis signaling game.
Oren Bochman
Tuesday, March 11, 2025

Emergent Languages
A working paper on emergent languages
Oren Bochman
Tuesday, January 14, 2025

Planning in the Complex Lewis Game
Today I want to consider a couple of weak assumption about planning in the Complex Lewis game. Yet before I do I ought to revisit the basic form of the Lewis Signaling game…
Oren Bochman
Tuesday, January 14, 2025

The Referential Lewis Signaling Game
When I read a few papers using the referential Lewis signaling game I thought, this should be much faster for complex signaling games I use in my research. But when I got to…
Oren Bochman
Tuesday, January 14, 2025

A garden of forking paths
I’ve been thinking how to visualize learning the complex lewis games.
Oren Bochman
Saturday, January 11, 2025

Complex Signals Questions
Question: how can we use planning in the Lewis Signaling Game.
Oren Bochman
Monday, January 6, 2025

The Many Path To A Signaling System
The Garden of Forking Paths — Jorge Luis Borges
Oren Bochman
Sunday, January 5, 2025

Off-Policy Learning
RL is full of big words like “off-policy learning” and “importance sampling”. If big words scare you, you are not alone. But most of the ideas in RL are simple and…
Oren Bochman
Saturday, January 4, 2025

Rethinking Signaling systems via the lens of compositionality
In (Skyrms 2010) the author discusses the evolution of signaling systems and the emergence of language as well as the role of compositionality in the emergence of language…
Oren Bochman
Thursday, January 2, 2025

Lewis Signaling Game for PettingZoo
The above is a basic version of the Lewis Signaling Game implemented in PettingZoo. The game consists of a sender and one or more receivers.
Oren Bochman
Wednesday, January 1, 2025

Books, Courses Tools
An Introduction to Statistical Learning by Gareth James, Daniela Witten, Trevor Hastie and Robert Tibshirani.
Oren Bochman
Wednesday, January 1, 2025

Villeny pure and simple
So much has been written about capone, and gangster movies here is a little note on character building in Noir. Noir characters were often minmal stereotypes, but some…
Oren Bochman
Thursday, December 12, 2024

Misbehavior of Markets and Scaling in financial prices 1-4
Review of Mandelbrot’s papers on scaling in financial prices and his popular science book The (Mis)behaviour of Markets.
Oren Bochman
Monday, December 2, 2024

Scaling in financial prices 4
“In the Brownian model, such a high level of concentration has a probability so minute that it should never happen. Unfortunately for the model, it happens every decade.”
Oren Bochman
Sunday, December 1, 2024

Scaling in financial prices 3
In the paper “Scaling in financial prices: III. Cartoon Brownian Motions in Multifractal Time” (Mandelbrot 2001) Mandelbrot continus his exploration of fractal and…
Oren Bochman
Saturday, November 30, 2024

Scaling in financial prices 2
In the paper “Scaling in financial prices: II. Multifractals and the star equation” (Mandelbrot 2001) Mandelbrot continus his exploration of financial price scaling. He…
Oren Bochman
Friday, November 29, 2024

Scaling in financial prices 1
“The ideal market completely disregards those spikes—but a realistic model cannot.”
Oren Bochman
Thursday, November 28, 2024

Compositionality in Lewis signaling games and MARL transfer learning.
Compositionality means different things to different people in different contexts, which is irksome to the student, renders researches prone to vagaries and foist unexpected…
Oren Bochman
Monday, October 14, 2024

Vitter’s Algorithm
This is the Vitter algorithm - an algorithm for encoding and decoding messages based on using Huffman prefix codes.
Oren Bochman
Friday, October 11, 2024

TL-DR rethinking 💭 topological alignment
Recently, I’ve been revisiting an old idea about creating a topological model of alignment. The machine translation task has been solved largely by using deep learning…
Oren Bochman
Tuesday, October 1, 2024

LLM the good the bad and the ugly
Early when I saw the first text by gpt2 I was intrigued that some of the researchers that did not get access to the early model and had to re-create the model based on just…
Oren Bochman
Monday, September 30, 2024

LLM and the missing link
The missing link is my name for a set of agents that should be able to edit wikipedia or at least to significantly reduce the effort needed to contribute to wikipedia.
Oren Bochman
Saturday, September 28, 2024

NLP with RL
supervised and unsupervised models are great for most NLP tasks, yet both approaches have their limitations. Supervised models require labeled data, which is usually in…
Oren Bochman
Friday, September 27, 2024

Deduction Evaluation
goal create a deduction data-set for evaluating reasoning capabilities of a man and machine.
Oren Bochman
Thursday, September 26, 2024

Fine-tune llm for Style and Grammar advice.
LLMs are amazing - can I fine tune a state of the art LLM like Lama 3.1 with what I consider to be very high quality writing from my private library content to create a…
Oren Bochman
Wednesday, September 25, 2024

Is compositionality overrated? The view from language emergence
A review of Marco Baroni’s talk on the emergence of languages and the role of compositionality in language evolution.
Oren Bochman
Sunday, September 1, 2024
 
Six quick tips to improve modeling
The following tips are from (Gelman and Hill 2007) Data Analysis Using Regression and Multilevel/Hierarchical Models by Andrew Gelman and Jennifer Hill.
Oren Bochman
Monday, August 26, 2024

Stumpy
Stumpy (Law 2019) is a powerful and scalable library for computing a matrix profile which can be used for a variety of time series data mining tasks.
Oren Bochman
Thursday, August 8, 2024

replay buffer questions
we should aim to keep full options traces in the buffer
Oren Bochman
Tuesday, July 2, 2024

two ideas on generalization
The first idea comes from looking at regression and hyperparameter optimization tasks
Oren Bochman
Monday, July 1, 2024

Mesa & RL
Ifs we can store state, action, reward trajectories (to a file) this would facilitate
Oren Bochman
Tuesday, June 25, 2024
 
zero inflated data
Zero inflated data is a type of data that has a large number of zero values.
Oren Bochman
Sunday, June 23, 2024
 
readings in rl
A list of RL-papers and resources that I have read or plan to read.
Oren Bochman
Tuesday, June 18, 2024
 
Hyperparameter Optimization
one the idea is for a set of Hyperparameters to find the best one.
Oren Bochman
Thursday, June 13, 2024

More Sugar please
In Sugar ad Astra I covered some research questions I had about Sugarscape. Today I’d like to mediate on some ideas I have for extending sugarscape to make it more of…
Oren Bochman
Tuesday, June 11, 2024

Risk-constrained Markov decision processes
by Vivek Borkar and Rahul Jain
Oren Bochman
Tuesday, June 11, 2024

Evolutionary Games and Population Dynamics Summary
I’ve recently come across a book called “Evolutionary Games and Population Dynamics” by Josef Hofbauer and Karl Sigmund.
Oren Bochman
Sunday, May 12, 2024

Roth Erev learning in Lewis signaling games
I wish now to implement learning in the Lewis signaling game. In the book some reinforcement learning RL algorithms are presented in some detail and a few variations are…
Oren Bochman
Thursday, May 9, 2024

Signals Experiment
some refactoring ideas:
Oren Bochman
Tuesday, May 7, 2024

ad hoc complex signaling systems
A deep dive into the complex signaling systems
Oren Bochman
Sunday, May 5, 2024

Shannon Game
In this note I want to start to explore one of my notions of compositionality of Lewis games with another game. In my thinking currently consider at least three senses for…
Oren Bochman
Thursday, May 2, 2024

Urn models using Numpy
“There is a tendency in our planning to confuse the unfamiliar with the improbable. The contingency we have not considered seriously looks strange; what looks strange is…
Oren Bochman
Thursday, May 2, 2024

RAD REPL
TODO: 1. [x] basic REPL 2. [x] command based class 3. [x] add task command 4. [x] list tasks command 5. [x] set current task command 6. [x] complete task command
Oren Bochman
Wednesday, May 1, 2024

Mesa Lessons
Implementing Sugarscape has some interesting lessons.
Oren Bochman
Sunday, March 31, 2024

Sugar Scapes
Agent movement rule M:
Oren Bochman
Sunday, March 31, 2024
 
OCR building blocks
split into:
Oren Bochman
Thursday, March 28, 2024

Patric Winston

A definition by Patrick Henry Winston
Patrick Henry Winston provides a definition of AI. How he keeps expanding his definition as he goes along is thing of beauty. It expands organicaly to incorporate new ideas…
Oren Bochman
Sunday, March 3, 2024
 
OCR - Brain Dump
Working of OCR articles by Susmith Reddy
Oren Bochman
Sunday, February 25, 2024

Rhetoric NLP Tasks
I recently have been annotating speeches following up on the edx a course on Rhetoric.
Oren Bochman
Saturday, February 17, 2024

mermaid logo

😁 Quarto 💖 Mermaid🧜 Mindmaps 🧠
Quarto at last supports Mindmap charts using Mermaid charts.
Oren Bochman
Monday, February 12, 2024

Lewis Game from a Bayesian Perspective
Some thoughts on the Lewis signaling game
Oren Bochman
Monday, February 12, 2024

man standing beside pipes by Kaique Rocha

The Great Migration
some migration notes from Blooger to Jekyl to Quarto blog.
Oren Bochman
Tuesday, January 30, 2024

Post With Code
This is an obligatory post with executable code.
Oren Bochman
Sunday, January 28, 2024

SuperLearner
SuperLearner is an ensambeleing library.
Oren Bochman
Wednesday, January 10, 2024

Engineering Reinforcement Learning Algorithms
As I progressed though the RL specialization I came to realize that the research is mostly about coming up with a new algorithm that works better. This is tricky and so in…
Oren Bochman
Wednesday, January 10, 2024

Understanding Emergent Languages
Okay after taking a break, today I’ve been rethinking Complex Lewis signaling systems and the equilibria. I slow make progress in this area by considering a number of…
Oren Bochman
Thursday, January 4, 2024

D3.js in in Quarto Observable
So I’ve migrated my sample to Quarto – which supports d3.js via Observable and without the need for whack hacks
Oren Bochman
Tuesday, January 2, 2024

AutoGluon Cheetsheets
Autogluon is a auto-ml framework, here are three cheetsheet for accellerating data science workloads
Oren Bochman
Wednesday, December 20, 2023
 
Summary: Synthesis and Stabilization of Complex Behaviors through Online Trajectory Optimization
This paper was referenced by Drew Bagnell in the Coursera RL specilization for using simple quadratic approximation to learn a model in a continous control setting. The…
Oren Bochman
Thursday, June 1, 2023
 
Spark Tips
https://stackoverflow.com/questions/30245180/what-do-the-numbers-on-the-progress-bar-mean-in-spark-shell#:~:text=This%20progress%20indicator%20means%20that,number%20of%20task…
Oren Bochman
Thursday, June 1, 2023
 
MCMC algorithms
The procedure MetropolisHastings takes as input : - the target distribution p(x), - the proposal distribution q(x,y), - the initial sample x_0, and - the total number of…
Oren Bochman
Saturday, April 22, 2023
 
Quarto loves pseudocode
\begin{algorithm} \caption{Quicksort} \begin{algorithmic} \Procedure{Quicksort}{$A, p, r$} \If{$p < r$} \State $q = $ \Call{Partition}{$A, p, r$} \State…
Oren Bochman
Tuesday, April 11, 2023

slide

Text2topic Leverage reviews data for multi-label topics classification in Booking.com
Having millions of customer reviews, we would like to better understand them and leverage this data for different use cases. For example, finding popular activities per…
Oren Bochman
Tuesday, February 28, 2023

slide

Validating NLP data and models
NLP data, and unstructured data in general, is very hard to validate. Validating NLP data is a real challenge, as actions such as statistical analysis and segmentation…
Oren Bochman
Tuesday, February 28, 2023
 
Transformations in Linguistic Representation
In computational linguistics, using different representations can shed light on the structure of language. I’m considering how sentences can be depicted using parse trees or…
Oren Bochman
Wednesday, February 22, 2023
 
event generator
fake data
Oren Bochman
Thursday, February 16, 2023

OLS regression From Scratch
OLS regression is a method for estimating the parameters of a linear regression model. The goal is to find the line that best fits a set of data points. The line is…
Oren Bochman
Wednesday, February 1, 2023
 
entropy for uncertainty quantification
There is an e-commerce store. Every day it collects the cost, sales and shelf price for each product. Let’s say we also have to deduct a sales tax or value added tax say at…
Oren Bochman
Thursday, September 22, 2022

wikisym 2012 logo

Wikisym 2012
Due to a kind grant by the WikiMedia Foundation I was able to attend Wikisym 2012 in Linz Austria what follows is my report on the event.
Oren Bochman
Tuesday, July 26, 2022
 
Set Up M1 MacBooks for DS & ML
Set Up M1 MacBooks for DS & ML
Oren Bochman
Thursday, May 5, 2022
 
command line
command line cheea sheet macos + zsh + git
Oren Bochman
Thursday, May 5, 2022

Meme bank
A meme is an idea, behavior, style, or usage that spreads from person to person within a culture. A meme bank would be a zoo for cataloging and breeding memes.
Oren Bochman
Thursday, December 30, 2021

Getting more from your agency ?
Getting more from your digital marketing agency, my five cents on picking your agency.
Oren Bochman
Monday, September 27, 2021

Excel 2019 for Marketing Statistics in pandas
Excel 2019 for Marketing Statistics in pandas
Oren Bochman
Friday, September 24, 2021

Language models and explainability
Language models and explainability
Oren Bochman
Friday, September 24, 2021

Attention for sensor fusion
Attention for sensor fusion
Oren Bochman
Friday, September 24, 2021

Storytelling and other essentials
Storytelling and other essentials,
Oren Bochman
Thursday, September 2, 2021

Stochastic Gradient Descent - The good parts
Stochastic Gradient Descent - The good parts
Oren Bochman
Sunday, August 29, 2021

WaveNet
The WaveNet paper is kind of old. Yet it seems to come up in various contexts. Some thoughts on this.
Oren Bochman
Sunday, August 29, 2021

Python Graphs
Python Graph Cookbook
Oren Bochman
Sunday, August 29, 2021

What is in a citation?
Creating Citation Web Components
Oren Bochman
Sunday, August 29, 2021

Hackathon session link dumps & notes
Wikipedia Hackathon notes
Oren Bochman
Friday, August 13, 2021

Inlining Citations for Wikipedia articles
An algorithm for Inlining Citations for Wikipedia articles.
Oren Bochman
Friday, August 13, 2021

Transfer learning in NLP
Transfer learning in NLP
Oren Bochman
Thursday, August 12, 2021

A type of Witness and an evolving Idiom
writing better code = writing more readable code.
Oren Bochman
Wednesday, July 14, 2021
 
json-ld
I’ve been excited about JSON-LD, when it came out as it offered a much cleaner way to do SEO. However It dawned on me later that it is also a geat format to worked with…
Oren Bochman
Thursday, July 1, 2021

TensorFlow probability
In a recent google ai blog post an transformer based autoencoder is shown that can be used to learn and generate document layouts.
Oren Bochman
Tuesday, June 1, 2021

Ebook Hacks
A number of djvu docs collected over a long time need to be convert them into pdf.
Oren Bochman
Saturday, May 29, 2021

Multilevel Models
Different Multilevel Models Types
Oren Bochman
Sunday, May 16, 2021

Q&A and the Winograd schemas
The classical Q&A task is fairly easy to solve. But how well does the IR system understand/model the data. The challenge to test this aspect of the system is to provide test…
Oren Bochman
Tuesday, April 27, 2021

Automatic Summarization Task
Concepts, slide commentaries and Lecture notes on Automatic text Summarization by Masa Nekic
Oren Bochman
Saturday, April 24, 2021

Bayesian agents
Let’s try to define a KR framework for a Bayesian agent.
Oren Bochman
Wednesday, April 14, 2021

Modeling Events
Modeling Events.
Oren Bochman
Friday, April 9, 2021

Language Models Are Open Knowledge Graphs
A review of the paper “Language Models are Open Knowledge Graphs” by Chenguang Wang, Xiao Liu, Dawn Song arXiv:2010.11967
Oren Bochman
Wednesday, April 7, 2021

Linkage 2021-04-07
Cleaning up my Tabs:
Oren Bochman
Wednesday, April 7, 2021

10 Tips To Improve Your Workflow
How to blog like a life-hacker.
Oren Bochman
Wednesday, April 7, 2021

Jekyll take 3
My attempts to get the jekyll version of this site to also build locally.
Oren Bochman
Sunday, April 4, 2021

MathJax 3 fix for Jekyll hosted on Github pages
Issues and workarounds for MatchJax 3.0.
Oren Bochman
Sunday, April 4, 2021

Effective Approaches to Attention-based NMT
Review of the paper on dot product attention for the deeplearning.ai NLP specialization.
Oren Bochman
Sunday, March 21, 2021

numpy melt down
numpy melt down.
Oren Bochman
Sunday, November 29, 2020

Deep Learning Intuitions
Stacking n-layers RELUS in a feed forward neural network is functionally equivalent to a set of nested inequalities.
Oren Bochman
Sunday, October 25, 2020
 
brace expansion
  • the bash shell supports brace expansion.
  • the idea is that the string before and after are concatenated with element in the braces
echo "you won "{two,three,four}"…
Oren Bochman
Friday, June 12, 2020

Pandas Productivity Challenge?
Just a little rant on Pandas various contexts
Oren Bochman
Wednesday, March 4, 2020

How to avoid cross site scripting (XSS) errors with the Jupyter local runtime for Colab
So the trick is
Oren Bochman
Thursday, February 20, 2020

Docker for data science
Post description
Oren Bochman
Sunday, November 24, 2019
 
Exploding and vanishing nodes.
One paradgm is that the network could be dynamic. For such a model we want to be able to add and remove nodes. This could be an issue for networks that are engineered to…

Oren Bochman
Wednesday, July 31, 2019

text annotation with BRAT
BRAT is a rapid annotation tool. Its old no long maintained - the original developers seem to have moved on. Requests for RTL support have been largely ignored. Some…
Oren Bochman
Tuesday, January 16, 2018

A/B testing cost and risks?
A/B testing cost and risks and some recommendation.
Oren Bochman
Sunday, July 30, 2017

Travel checklist
    • Oren Bochman
    Wednesday, December 14, 2016
     
    HotJar Heat Map Analysis - Dr. David Darmanin
    What are Heatmaps
    Oren Bochman
    Wednesday, April 20, 2016
     
    Using Competitive Analysis to Benchmark Your Marketing Efforts Ariel Rosenstein - Similar Web
    Mr Jerbi’s Background:       Come to web analytics from academia Industry and Management - Scheduling and QA.       Recalls that before it was bought by Google Urchin cost…
    Oren Bochman
    Monday, April 20, 2015
     
    Using Competitive Analysis to Benchmark Your Marketing Efforts - Ariel Rosenstein - Similar Web
    Ari is the Sr. Marketing Director at Similarweb
    Oren Bochman
    Monday, April 20, 2015
     
    Analytics Checklist
    Oren Bochman
    Saturday, February 7, 2015
     
    life hacks
    Health and supplements:
    Oren Bochman
    Friday, June 7, 2013

    Text Mining With Python
    processing unknown tokens
    Oren Bochman
    Tuesday, November 29, 2011

    Text Mining With R
    Computational Linguistics tasks:
    Oren Bochman
    Tuesday, November 29, 2011

    Tidy Text Mining With R
    Computational Linguistics tasks:
    Oren Bochman
    Tuesday, November 29, 2011

    Photo by Pixabay

    Time management Tips
    Effective time management is crucial for success in both personal and professional life. With the right approach, you can achieve more in less time while maintaining a…
    Oren Bochman
    Thursday, August 11, 2011
    No matching items