Oren Bochman’s Blog
Home
About
Source Code
Report a Bug
Archive
Oren Bochman’s Blog
Notes
Paper Reviews
Reviews
1973
🏒 Hockey Helmets, Concealed Weapons, and Daylight Saving – Binary Choices with Externalities
1989
Skeletonization: A Technique for Trimming the Fat from a Network via Relevance Assessment
1991
Simplifying Neural Networks by soft weight sharing
1998
On Learning To Become a Successful Loser
1999
2000
🤝 Costly Signaling and Cooperation
2005
🗣️ Talking to Neighbors: Evolution of Regional Meaning in Communication Games
2006
title
🧠 Technical Introduction: A primer on probabilistic inference
🧠 Theory-Based Bayesian Models of Inductive Learning and Reasoning
2007
The Evolution of Coding in signaling games
Goal Inference as Inverse Planning
2008
2009
Evolutionary dynamics of Lewis signaling games: signaling systems vs. partial pooling
2010
Signals: Signals: Evolution, Learning, and Information
2011
2012
Multi-column Deep Neural Networks for Image Classification
Improving Neural Networks by Preventing Co-Adaptation of Feature Detectors
ImageNet Classification with Deep Convolutional Neural Networks
2013
Simulation as an engine of physical scene understanding
NIN — Network in Network
Handwriting beautification using token means
2014
Dropout: A Simple Way to Prevent Neural Networks from Overfitting
Some dynamics of signaling games
VGGNet: Very Deep Convolutional Networks for Large-Scale Image Recognition
2015
Variational Inference with Normalizing Flows
sense2vec - A Fast and Accurate Method for Word Sense Disambiguation In Neural Word Embeddings
2016
Shen Parsing RL
2017
🤝 Diversity Bonuses: How Diverse Teams Achieve Superior Results
️👮 Multi-agent Reinforcement Learning in Sequential Social Dilemmas
2018
Emergence of Linguistic Communication from Referential Games with Symbolic and Pixel Input
Learning Shape Priors for Single-View 3D Completion and Reconstruction
2019
Linguistic generalization and compositionality in modern artificial neural networks
2020
ViT — An Image is worth 16x16 words: Transformers for Image Recognition at scale
Compositionality and Generalization in Emergent Languages
Why Overfitting Isn’t Always Bad: Retrofitting Cross-Lingual Word Embeddings to Dictionaries
2021
Generally Capable Agents Emerge from Open-Ended Play
Emergent Communication of Generalizations
2022
2023
Temporal Abstraction in Reinforcement Learning with the Successor Representation
🦚 Honest Signalling Made Simple
2024
Tree Attention: Topology-Aware Decoding for Long-Context Attention on GPU Clusters
FontCLIP: A Semantic Typography Visual-Language Model for Multilingual Font Applications
LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders
MambaVision A Hybrid Mamba-Transformer Vision Backbone
Q*: Improving Multi-step Reasoning for LLMs with Deliberative Planning
2BP: 2-Stage Backpropagation
TheoremLlama An End-To-End Framework to Train a General-Purpose Large Language Model to Become a Lean4 Expert
Smaller, Weaker, Yet Better: Training LLM Reasoners via Compute-Optimal Sampling
2025
Meta
Why bother reviewing papers?
Blog
Posts
2011
Tidy Text Mining With R
Text Mining With Python
Time management Tips
Text Mining With R
2012
Wikisym 2012
2013
life hacks
2014
2014 10 06 FinTech
2015
2015 02 07 Analytics Checklist
Analytics Checklist
2015 02 07 Optimal Bidding
2015 04 20 All Things Data
HotJar Heat Map Analysis - Dr. David Darmanin
Using Competitive Analysis to Benchmark Your Marketing Efforts Ariel Rosenstein - Similar Web
Using Competitive Analysis to Benchmark Your Marketing Efforts - Ariel Rosenstein - Similar Web
2016
Travel checklist
2017
2017 07 30 Experimental Design
A/B testing cost and risks?
2018
2018 01 16 BRAT
text annotation with BRAT
2019
2019 07 31 Exploding and Vanishing Nodes
Exploding and vanishing nodes.
2019 11 24 Keys to the Kingdom Extracting Api Keys from a Json File with Jq
Docker for data science
2020
brace expansion
2020 02 20 Avoid Cross Site Scriptin Errors with a Jupyter Local Runtime
How to avoid cross site scripting (XSS) errors with the Jupyter local runtime for Colab
2020 03 04 Pandas Challanges
Pandas Productivity Challenge?
2020 04 10 Pdf Extraction
2020 10 25 Deep Learning Relu Intutions
Deep Learning Intuitions
2020 11 29 Numpy Meltdown
numpy melt down
2020 12 30 Meme Bank
Meme bank
2021
Transfer learning in NLP
Excel 2019 for Marketing Statistics in pandas
Inlining Citations for Wikipedia articles
WaveNet
Storytelling and other essentials
Getting more from your agency ?
What is in a citation?
Stochastic Gradient Descent - The good parts
2021 03 21 Review of Effective Approaches to Attention Based Neural Machine Translation
Effective Approaches to Attention-based NMT
2021 03 21 Review of Language Models Are Open Knowledge Graphs
Language Models Are Open Knowledge Graphs
2021 04 03 Ruby Installation Snafus
Jekyll take 3
2021 04 06 Jekyll Mathjax 3.0 Fix
MathJax 3 fix for Jekyll hosted on Github pages
2021 04 07 Linkage
Linkage 2021-04-07
2021 04 07 Ten Tips to Improve Your Workflow
10 Tips To Improve Your Workflow
2021 04 08 Other People Problems
2021 04 09 Modeling Events
Modeling Events
2021 04 11 Lexical and Semantic Features
2021 04 24 Summerization
Automatic Summarization Task
2021 04 25 Bayesian Agent
Bayesian agents
2021 04 27 Wingrad Schema
Q&A and the Winograd schemas
2021 05 16 Mulitlevel Models
Multilevel Models
2021 05 18 Bayesian Betting
2021 05 29 Djvu to Pdf
Ebook Hacks
2021 06 10 Layout Models
TensorFlow probability
2021 07 01 Json Ld
json-ld
2021 07 14 Type Witness Evolving Idiom
A type of Witness and an evolving Idiom
2021 08 13 Hackathon Notes
Hackathon session link dumps & notes
2021 09 16 Python Graphs
Python Graphs
2021 11 08 Advanced ML Workflows
2021 11 12 Language Models and Explainability
Language models and explainability
2021 12 07 Attention for Sensor Fusion
Attention for sensor fusion
2022
2022 03 05 M1
Set Up M1 MacBooks for DS & ML
2022 04 01 Bandits
2022 05 05 Command Line
command line
2022 09 12 Robust Regression
2022 09 16 Adaptive Learning Rate
2022 09 16 Loss Engineering
2022 09 22 Entropy for Uncertainty Quantification
entropy for uncertainty quantification
2023
AutoGluon Cheetsheets
The Great Migration
2023-01-11-NLP-IL-Intuit Meetup
2023 02 01 Ds from Scratch
OLS regression From Scratch
2023 02 20 Ts Nonlinear
2023 02 28 NLP.IL Booking.com
Text2topic Leverage reviews data for multi-label topics classification in Booking.com
Validating NLP data and models
2023 03 01 Braindump
2023 03 01 Spark Emr
2023 03 08 Responsible AI
2023 04 11 Quarto Loves Psdocode
Quarto loves pseudocode
2023 04 22 Mcmc Algs
MCMC algorithms
2023 06 01 Spark
Spark Tips
2023 06 01 Synthesis and Stabilization
Summary: Synthesis and Stabilization of Complex Behaviors through Online Trajectory Optimization
S3 Series
2024
readings in rl
LLM and the missing link
ad hoc complex signaling systems
Shannon Game
OCR - Brain Dump
TL-DR rethinking 💭 topological alignment
two ideas on generalization
Deduction Evaluation
SuperLearner
Evolutionary Games and Population Dynamics Summary
D3.js in in Quarto Observable
A definition by Patrick Henry Winston
Is compositionality overrated? The view from language emergence
Vitter’s Algorithm
Lewis Signaling Game for PettingZoo
NLP with RL
Signals Experiment
Lewis Game from a Bayesian Perspective
Stumpy
Understanding Emergent Languages
More Sugar please
event generator
replay buffer questions
RAD REPL
Villeny pure and simple
OCR building blocks
Post With Code
LLM the good the bad and the ugly
Mesa Lessons
Transformations in Linguistic Representation
😁 Quarto 💖 Mermaid🧜 Mindmaps 🧠
Six quick tips to improve modeling
Fine-tune llm for Style and Grammar advice.
Sugar Scapes
2024 02 01 Quarto Bootstrap
2024 02 19 Rhetoric
Rhetoric NLP Tasks
2024 05 02 Signaling Games Tikz
2024 05 03 Urn Models
Urn models using Numpy
2024 05 04 Signals Bib
2024 05 09 Roth Erev RL
Roth Erev learning in Lewis signaling games
2024 06 01 Bayesian Agents
2024 06 11 Risk Constrained MDP
Risk-constrained Markov decision processes
2024 06 12 Logic Puzzles
2024 06 13 Hyper
Hyperparameter Optimization
2024 06 23 Zero Inflated Data
zero inflated data
2024 06 25 Mesa Rl
Mesa & RL
Misbehavior of Markets and Scaling in financial prices 1-4
Scaling in financial prices 3
Scaling in financial prices 2
Scaling in financial prices 4
Scaling in financial prices 1
2025
The roles of Partial pooling and mixed strategies in the Lewis signaling game
Rethinking Signaling systems via the lens of compositionality
The Referential Lewis Signaling Game
Books, Courses Tools
Engineering Reinforcement Learning Algorithms
Compositionality in Lewis signaling games and MARL transfer learning.
Emergent Languages
Complex Signals Questions
Planning in the Complex Lewis Game
Off-Policy Learning
A garden of forking paths
The Many Path To A Signaling System
Podcast
Categories
All
(118)
A/B testing
(1)
AI
(2)
Analytics
(2)
Auto Regressive Flows
(1)
BigData
(1)
Bijectors
(1)
CRO,
(1)
CVaR
(1)
Competitive Analysis
(1)
Complex Behaviors
(1)
Conference
(1)
Cost Functions
(1)
Coursera
(1)
Financial Markets
(5)
Fractals
(5)
Google-colab
(1)
Heat Maps
(1)
Humanoid Robots
(1)
Iterative LQG Method
(1)
LLM
(1)
LQR
(1)
Lewis signaling games
(2)
Lotka-Volterra
(1)
ML
(1)
MPC
(1)
Marketing
(1)
Markov games
(1)
Model Based RL
(1)
Model Predictive Control
(1)
MuJoCo
(1)
NLP
(14)
Numerical Methods
(1)
OCR
(2)
Optimal Control
(1)
PPC
(1)
PPC,
(1)
Physics Simulator
(1)
Planning
(1)
Popular Science
(3)
R
(3)
Real-Time Control
(1)
Reinforcement Learning
(1)
Reviews
(5)
Robtics
(1)
Robustness
(1)
Rumpelstiltskin principle
(1)
Scaling Laws
(5)
Spark
(1)
TODO
(1)
TRIZ
(1)
Text Mining
(1)
Time series
(5)
Trajectory Optimization
(1)
XSS
(1)
agency
(1)
agent-based modeling
(2)
agent-based social simulation
(1)
agents
(1)
ai
(1)
algorithm
(1)
algorithms
(1)
all things data
(1)
analysis
(2)
analytics
(1)
artificial intelligence
(1)
attention
(2)
auto-ml
(1)
autoecoder
(1)
automatic abstracting
(1)
automatic extracting
(1)
awsome-learning
(1)
bash
(1)
bayesian games
(2)
bayesian reinforcement learning
(1)
bibliography
(2)
blogging
(3)
brain dump
(1)
brain farts
(1)
brainstorm
(1)
buggy code
(1)
bugs
(1)
chat bot
(3)
cheatsheets
(1)
checklist
(1)
citations
(1)
code
(11)
colab
(1)
command line
(1)
communication protocols
(1)
comparative evaluation
(1)
complex signaling system
(13)
compositionality
(5)
conference
(2)
content words
(1)
conternerization
(1)
cooperation
(1)
coursera
(1)
cue words
(1)
d3.js
(1)
data analysis
(3)
data mining
(1)
data science
(9)
data science,
(1)
data-science
(2)
data-wrangling
(1)
decision-making under uncertainty
(1)
deduction
(1)
deep learning
(6)
demos
(1)
digital marketing
(2)
digital marketing,
(1)
docker
(1)
document screening
(1)
ds-tips
(1)
dynamical systems
(1)
ebooks
(1)
emergent languages
(13)
evolutionary games
(1)
experimental design,
(1)
game theory
(3)
hacks
(2)
health
(1)
iLQG
(1)
idea
(2)
ideas
(1)
information science
(1)
information theory
(4)
intelligence
(2)
intuition
(1)
jekyll
(2)
jupyter
(1)
kb-ai
(1)
key words
(1)
kramdown
(1)
language evolution
(4)
language models
(1)
lecture notes
(2)
lewis signaling game
(2)
life
(1)
linguistics
(4)
linkage
(1)
links
(1)
linux
(1)
literature review
(3)
logic
(1)
logistic growth
(1)
mac
(2)
machine learning
(1)
macos
(1)
marketing
(5)
mathematics
(1)
mathjax
(1)
meme
(1)
mesa
(1)
ml
(1)
modelling
(4)
multi-agent reinforcement learning
(1)
multi-agent simulation
(1)
neural networks
(3)
news
(3)
nlp
(3)
noir
(1)
non-cooperative games
(1)
notes
(4)
observable.js
(1)
off-policy learning
(1)
orgenizational behviour
(1)
paper
(2)
paper review
(1)
papers
(1)
parameterization
(1)
patterns
(1)
population dynamics
(1)
pragmatic words
(1)
predator-prey model
(1)
probability
(1)
productivity
(3)
prompt engineering
(1)
python
(5)
quantitative marketing
(1)
quantitative marketing,
(1)
quarto
(1)
r
(1)
reading
(1)
reasoning
(1)
reinforcement learning
(11)
relevance
(1)
report
(1)
research
(1)
research methodology
(1)
resolution
(2)
review
(2)
review compositionality neural networks signaling systems language evolution
(1)
rhetoric
(2)
risk-constrained MDPs
(1)
rl
(1)
rl-algorithms
(1)
rl-papers
(1)
rl-resources
(1)
ruby
(1)
screenwriting
(1)
sensor fusion
(1)
sentence location
(1)
sentence selection
(1)
sentence significance
(1)
sequential social dilemmas
(1)
signaling games
(4)
signaling systems
(5)
speaking
(1)
statistics
(4)
stochastic optimization
(1)
sub-perfect bayesian equilibrium
(1)
sugarscape
(2)
summarization task
(2)
support
(3)
tetrad
(1)
text Mining
(1)
text mining
(1)
tidyverse
(1)
time management
(1)
title words
(1)
tool-tip
(1)
transfer learning
(2)
travel
(1)
urn models
(1)
video
(1)
war story
(1)
wikidata
(1)
wikipedia
(4)
wikisym
(1)
Oren Bochman’s Blog
Order By
Default
Date - Oldest
Date - Newest
Title
The roles of Partial pooling and mixed strategies in the Lewis signaling game
a game theoretic perspective
emergent languages
lewis signaling game
game theory
complex signaling system
Today I posit a couple of questions on the Lewis signaling game.
Tuesday, March 11, 2025
14 min
Emergent Languages
A Desiderata
emergent languages
reinforcement learning
information theory
linguistics
complex signaling system
A working paper on emergent languages
Tuesday, January 14, 2025
14 min
Planning in the Complex Lewis Game
compositionality
emergent languages
reinforcement learning
transfer learning
information theory
linguistics
Today I want to consider a couple of weak assumption about planning in the Complex Lewis game. Yet before I do I ought to revisit the basic form of the Lewis Signaling game…
Tuesday, January 14, 2025
15 min
The Referential Lewis Signaling Game
Back of the napkin complexity calculations
reinforcement learning
complex signaling system
When I read a few papers using the referential Lewis signaling game I thought, this should be much faster for complex signaling games I use in my research. But when I got to…
Tuesday, January 14, 2025
5 min
A garden of forking paths
I’ve been thinking how to visualize learning the complex lewis games.
Saturday, January 11, 2025
10 min
Complex Signals Questions
Research Notes
research
reinforcement learning
signaling systems
emergent languages
Question: how can we use planning in the Lewis Signaling Game.
Monday, January 6, 2025
1 min
The Many Path To A Signaling System
signaling systems
lewis signaling game
reinforcement learning
bayesian games
information theory
game theory
bayesian reinforcement learning
emergent languages
complex signaling system
The Garden of Forking Paths — Jorge Luis Borges
Sunday, January 5, 2025
11 min
Off-Policy Learning
For Dummies
reinforcement learning
off-policy learning
deep learning
machine learning
artificial intelligence
RL is full of big words like “off-policy learning” and “importance sampling”. If big words scare you, you are not alone. But most of the ideas in RL are simple and…
Saturday, January 4, 2025
2 min
Rethinking Signaling systems via the lens of compositionality
reinforcement learning
emergent languages
complex signaling system
In
(Skyrms 2010)
the author discusses the evolution of signaling systems and the emergence of language as well as the role of compositionality in the emergence of language…
Thursday, January 2, 2025
7 min
Books, Courses Tools
news
An Introduction to Statistical Learning by Gareth James, Daniela Witten, Trevor Hastie and Robert Tibshirani.
Wednesday, January 1, 2025
1 min
Lewis Signaling Game for PettingZoo
Paper Review
review
compositionality
neural networks
signaling systems
language evolution
The above is a basic version of the Lewis Signaling Game implemented in PettingZoo. The game consists of a sender and one or more receivers.
Wednesday, January 1, 2025
11 min
Villeny pure and simple
Scar face Capone in the valentine’s day massacre
screenwriting
patterns
noir
So much has been written about capone, and gangster movies here is a little note on character building in Noir. Noir characters were often minmal stereotypes, but some…
Thursday, December 12, 2024
6 min
Misbehavior of Markets and Scaling in financial prices 1-4
Four papers and a book
Scaling Laws
Fractals
Financial Markets
Time series
Reviews
Popular Science
Review of Mandelbrot’s papers on scaling in financial prices and his popular science book The (Mis)behaviour of Markets.
Monday, December 2, 2024
6 min
Scaling in financial prices 4
Multifractal Concentration
Scaling Laws
Fractals
Financial Markets
Time series
Reviews
“In the Brownian model, such a high level of concentration has a probability so minute that it should never happen. Unfortunately for the model, it happens every decade.”
Sunday, December 1, 2024
13 min
Scaling in financial prices 3
Cartoon Brownian Motions in Multifractal Time
Scaling Laws
Fractals
Financial Markets
Time series
Reviews
In the paper “Scaling in financial prices: III. Cartoon Brownian Motions in Multifractal Time”
(Mandelbrot 2001)
Mandelbrot continus his exploration of fractal and…
Saturday, November 30, 2024
14 min
Scaling in financial prices 2
Multi-fractals and the star equation
Scaling Laws
Fractals
Financial Markets
Time series
Reviews
Popular Science
In the paper “Scaling in financial prices: II. Multifractals and the star equation”
(Mandelbrot 2001)
Mandelbrot continus his exploration of financial price scaling. He…
Friday, November 29, 2024
12 min
Scaling in financial prices 1
Tails and dependence
Scaling Laws
Fractals
Financial Markets
Time series
Reviews
Popular Science
“The ideal market completely disregards those spikes—but a realistic model cannot.”
Thursday, November 28, 2024
13 min
Compositionality in Lewis signaling games and MARL transfer learning.
compositionality
emergent languages
reinforcement learning
transfer learning
information theory
linguistics
complex signaling system
Compositionality
means different things to different people in different contexts, which is irksome to the student, renders researches prone to vagaries and foist unexpected…
Monday, October 14, 2024
30 min
Vitter’s Algorithm
review compositionality neural networks signaling systems language evolution
This is the Vitter algorithm - an algorithm for encoding and decoding messages based on using Huffman prefix codes.
Friday, October 11, 2024
7 min
TL-DR rethinking 💭 topological alignment
NLP
Recently, I’ve been revisiting an old idea about creating a topological model of alignment. The machine translation task has been solved largely by using deep learning…
Tuesday, October 1, 2024
12 min
LLM the good the bad and the ugly
An essay on the limitations of language models
NLP
Early when I saw the first text by gpt2 I was intrigued that some of the researchers that did not get access to the early model and had to re-create the model based on just…
Monday, September 30, 2024
7 min
LLM and the missing link
wikipedia
LLM
AI
agents
wikidata
citations
The missing link is my name for a set of agents that should be able to edit wikipedia or at least to significantly reduce the effort needed to contribute to wikipedia.
Saturday, September 28, 2024
2 min
NLP with RL
supervised and unsupervised models are great for most NLP tasks, yet both approaches have their limitations. Supervised models require labeled data, which is usually in…
Friday, September 27, 2024
3 min
Deduction Evaluation
logic
reasoning
deduction
goal create a deduction data-set for evaluating reasoning capabilities of a man and machine.
Thursday, September 26, 2024
2 min
Fine-tune llm for Style and Grammar advice.
NLP
LLMs are amazing - can I fine tune a state of the art LLM like Lama 3.1 with what I consider to be very high quality writing from my private library content to create a…
Wednesday, September 25, 2024
5 min
Is compositionality overrated? The view from language emergence
review
compositionality
neural networks
signaling systems
language evolution
complex signaling system
A review of Marco Baroni’s talk on the emergence of languages and the role of compositionality in language evolution.
Sunday, September 1, 2024
29 min
Six quick tips to improve modeling
The following tips are from
(Gelman and Hill 2007)
Data Analysis Using Regression and Multilevel/Hierarchical Models by Andrew Gelman and Jennifer Hill.
Monday, August 26, 2024
3 min
Stumpy
Times Series Analysis
Stumpy
(Law 2019)
is a powerful and scalable library for computing a matrix profile which can be used for a variety of time series data mining tasks.
Thursday, August 8, 2024
6 min
replay buffer questions
we should aim to keep full options traces in the buffer
Tuesday, July 2, 2024
3 min
two ideas on generalization
The first idea comes from looking at regression and hyperparameter optimization tasks
Monday, July 1, 2024
6 min
Mesa & RL
Ifs we can store state, action, reward trajectories (to a file) this would facilitate
Tuesday, June 25, 2024
3 min
zero inflated data
Zero inflated data is a type of data that has a large number of zero values.
Sunday, June 23, 2024
6 min
readings in rl
rl
reinforcement learning
papers
notes
reading
rl-papers
rl-algorithms
rl-resources
A list of RL-papers and resources that I have read or plan to read.
Tuesday, June 18, 2024
9 min
Hyperparameter Optimization
one the idea is for a set of Hyperparameters to find the best one.
Thursday, June 13, 2024
2 min
More Sugar please
sugarscape
multi-agent simulation
agent-based modeling
agent-based social simulation
multi-agent reinforcement learning
sequential social dilemmas
cooperation
Markov games
non-cooperative games
complex signaling system
In Sugar ad Astra I covered some research questions I had about Sugarscape. Today I’d like to mediate on some ideas I have for extending sugarscape to make it more of…
Tuesday, June 11, 2024
24 min
Risk-constrained Markov decision processes
paper review
paper review
risk-constrained MDPs
stochastic optimization
CVaR
decision-making under uncertainty
by Vivek Borkar and Rahul Jain
Tuesday, June 11, 2024
5 min
Evolutionary Games and Population Dynamics Summary
mathematics
evolutionary games
population dynamics
Lotka-Volterra
dynamical systems
logistic growth
predator-prey model
I’ve recently come across a book called “Evolutionary Games and Population Dynamics” by Josef Hofbauer and Karl Sigmund.
Sunday, May 12, 2024
3 min
Roth Erev learning in Lewis signaling games
signaling games
reinforcement learning
Lewis signaling games
language evolution
signaling systems
neural networks
emergent languages
deep learning
complex signaling system
I wish now to implement learning in the Lewis signaling game. In the book some reinforcement learning RL algorithms are presented in some detail and a few variations are…
Thursday, May 9, 2024
44 min
Signals Experiment
Leaning language games
some refactoring ideas:
Tuesday, May 7, 2024
16 min
ad hoc complex signaling systems
a review and proposal
signaling games
emergent languages
complex signaling system
A deep dive into the complex signaling systems
Sunday, May 5, 2024
4 min
Shannon Game
emergent complex communications protocols
signaling games
compositionality
communication protocols
emergent languages
complex signaling system
In this note I want to start to explore one of my notions of compositionality of Lewis games with another game. In my thinking currently consider at least three senses for…
Thursday, May 2, 2024
12 min
Urn models using Numpy
probability
urn models
emergent languages
“
There is a tendency in our planning to confuse the unfamiliar with the improbable.
The contingency we have not considered seriously looks strange; what looks strange is…
Thursday, May 2, 2024
19 min
RAD REPL
TODO: 1. [x] basic REPL 2. [x] command based class 3. [x] add task command 4. [x] list tasks command 5. [x] set current task command 6. [x] complete task command
Wednesday, May 1, 2024
5 min
Mesa Lessons
reinforcement learning
mesa
agent-based modeling
sugarscape
Implementing Sugarscape has some interesting lessons.
Sunday, March 31, 2024
23 min
Sugar Scapes
Agent movement rule
M
:
Sunday, March 31, 2024
3 min
OCR building blocks
code
buggy code
TODO
OCR
split into:
Thursday, March 28, 2024
3 min
A definition by Patrick Henry Winston
For Artificial Intelligence
kb-ai
speaking
rhetoric
awsome-learning
ai
Rumpelstiltskin principle
Patrick Henry Winston provides a definition of AI. How he keeps expanding his definition as he goes along is thing of beauty. It expands organicaly to incorporate new ideas, accommodate example problems and aspects of their solutions. This is a powerful example of using inductive thinking to create definition using a philosophical approach.
Sunday, March 3, 2024
2 min
OCR - Brain Dump
linkage
brain dump
OCR
Working of OCR articles by
Susmith Reddy
Sunday, February 25, 2024
2 min
Rhetoric NLP Tasks
rhetoric
nlp
ideas
I recently have been annotating speeches following up on the edx a course on Rhetoric.
Saturday, February 17, 2024
3 min
Lewis Game from a Bayesian Perspective
Some thoughts on the Lewis signaling game
signaling games
Lewis signaling games
emergent languages
complex signaling system
Some thoughts on the Lewis signaling game
Monday, February 12, 2024
8 min
😁 Quarto 💖 Mermaid🧜 Mindmaps 🧠
Quarto at last supports Mindmap charts using Mermaid charts.
Monday, February 12, 2024
2 min
The Great Migration
From Blogger to Jekyl and finaly to Quarto.
quarto
blogging
code
some migration notes from Blooger to Jekyl to Quarto blog.
Tuesday, January 30, 2024
2 min
Post With Code
news
code
analysis
This is an obligatory post with executable code.
Sunday, January 28, 2024
4 min
Engineering Reinforcement Learning Algorithms
As I progressed though the RL specialization I came to realize that the research is mostly about coming up with a new algorithm that works better. This is tricky and so in…
Wednesday, January 10, 2024
3 min
SuperLearner
demos
code
r
SuperLearner is an ensambeleing library.
Wednesday, January 10, 2024
18 min
Understanding Emergent Languages
NLP
language evolution
emergent languages
complex signaling system
Okay after taking a break, today I’ve been rethinking Complex Lewis signaling systems and the equilibria. I slow make progress in this area by considering a number of…
Thursday, January 4, 2024
90 min
D3.js in in Quarto Observable
code
d3.js
observable.js
So I’ve migrated my sample to Quarto – which supports
d3.js
via Observable and without the need for whack hacks
Tuesday, January 2, 2024
4 min
AutoGluon Cheetsheets
Beacuase auto-ml is a Superpower
cheatsheets
code
data science
auto-ml
Autogluon is a auto-ml framework, here are three cheetsheet for accellerating data science workloads
Wednesday, December 20, 2023
1 min
Spark Tips
BigData
Spark
https://stackoverflow.com/questions/30245180/what-do-the-numbers-on-the-progress-bar-mean-in-spark-shell#:~:text=This%20progress%20indicator%20means%20that,number%20of%20task…
Thursday, June 1, 2023
1 min
Summary: Synthesis and Stabilization of Complex Behaviors through Online Trajectory Optimization
Reinforcement Learning
Model Based RL
Model Predictive Control
MPC
LQR
MuJoCo
iLQG
Cost Functions
Iterative LQG Method
Numerical Methods
Optimal Control
Trajectory Optimization
Complex Behaviors
Humanoid Robots
Physics Simulator
Real-Time Control
Robustness
Planning
Robtics
Coursera
This paper was referenced by Drew Bagnell in the Coursera RL specilization for using simple quadratic approximation to learn a model in a continous control setting. The paper presents a method for online trajectory optimization, particularly focusing on complex humanoid robots performing tasks such as getting up from an arbitrary pose and recovering from large disturbances using dexterous maneuvers.
Thursday, June 1, 2023
4 min
MCMC algorithms
The procedure
MetropolisHastings
takes as input : - the target distribution
p(x)
, - the proposal distribution
q(x,y)
, - the initial sample
x_0
, and - the total number of…
Saturday, April 22, 2023
4 min
Quarto loves pseudocode
\begin{algorithm} \caption{Quicksort} \begin{algorithmic} \Procedure{Quicksort}{$A, p, r$} \If{$p < r$} \State $q = $ \Call{Partition}{$A, p, r$} \State…
Tuesday, April 11, 2023
1 min
Text2topic Leverage reviews data for multi-label topics classification in Booking.com
NLP.IL
Having millions of customer reviews, we would like to better understand them and leverage this data for different use cases. For example, finding popular activities per…
Tuesday, February 28, 2023
2 min
Validating NLP data and models
NLP.IL
NLP data, and unstructured data in general, is very hard to validate. Validating NLP data is a real challenge, as actions such as statistical analysis and segmentation…
Tuesday, February 28, 2023
2 min
Transformations in Linguistic Representation
nlp
linguistics
In computational linguistics, using different representations can shed light on the structure of language. I’m considering how sentences can be depicted using parse trees or…
Wednesday, February 22, 2023
4 min
event generator
news
code
analysis
prompt engineering
fake data
Thursday, February 16, 2023
6 min
OLS regression From Scratch
data science
ml
algorithms
OLS regression is a method for estimating the parameters of a linear regression model. The goal is to find the line that best fits a set of data points. The line is…
Wednesday, February 1, 2023
2 min
entropy for uncertainty quantification
There is an e-commerce store. Every day it collects the
cost
,
sales
and
shelf price
for each product. Let’s say we also have to deduct a sales tax or value added tax say at…
Thursday, September 22, 2022
7 min
Wikisym 2012
Conference Report
report
wikisym
conference
Due to a kind grant by the WikiMedia Foundation I was able to attend Wikisym 2012 in Linz Austria what follows is my report on the event.
Tuesday, July 26, 2022
8 min
Set Up M1 MacBooks for DS & ML
mac
Set Up M1 MacBooks for DS & ML
Thursday, May 5, 2022
1 min
command line
productivity
mac
command line cheea sheet macos + zsh + git
Thursday, May 5, 2022
21 min
Meme bank
memes a problem-solving approach
meme
TRIZ
tetrad
brainstorm
algorithm
A meme is an idea, behavior, style, or usage that spreads from person to person within a culture. A meme bank would be a zoo for cataloging and breeding memes.
Thursday, December 30, 2021
4 min
Getting more from your agency ?
digital marketing agencies.
marketing
digital marketing
agency
Getting more from your digital marketing agency, my five cents on picking your agency.
Monday, September 27, 2021
8 min
Attention for sensor fusion
attention
data science
marketing
sensor fusion
statistics
autoecoder
Attention for sensor fusion
Friday, September 24, 2021
5 min
Excel 2019 for Marketing Statistics in pandas
data science
statistics
marketing
Excel 2019 for Marketing Statistics in pandas
Friday, September 24, 2021
2 min
Language models and explainability
data science
statistics
marketing
NLP
Language models and explainability
Friday, September 24, 2021
17 min
Storytelling and other essentials
data science
statistics
marketing
war story
Storytelling and other essentials,
Thursday, September 2, 2021
4 min
Python Graphs
PPC
code
data science
digital marketing
quantitative marketing
intelligence
Python Graph Cookbook
Sunday, August 29, 2021
3 min
Stochastic Gradient Descent - The good parts
Stochastic Gradient Descent - The good parts
Sunday, August 29, 2021
14 min
WaveNet
paper review
deep learning
data science
NLP
The WaveNet paper is kind of old. Yet it seems to come up in various contexts. Some thoughts on this.
Sunday, August 29, 2021
4 min
What is in a citation?
Creating Citation Web Components
Sunday, August 29, 2021
4 min
Hackathon session link dumps & notes
modelling
chat bot
wikipedia
support
Wikipedia Hackathon notes
Friday, August 13, 2021
2 min
Inlining Citations for Wikipedia articles
modelling
chat bot
wikipedia
support
An algorithm for Inlining Citations for Wikipedia articles.
Friday, August 13, 2021
11 min
Transfer learning in NLP
modelling
chat bot
wikipedia
support
Transfer learning in NLP
Thursday, August 12, 2021
3 min
A type of Witness and an evolving Idiom
writing better code = writing more readable code.
Wednesday, July 14, 2021
2 min
json-ld
metadata format for linked data
information science
I’ve been excited about JSON-LD, when it came out as it offered a much cleaner way to do SEO. However It dawned on me later that it is also a geat format to worked with…
Thursday, July 1, 2021
4 min
TensorFlow probability
ML
AI
NLP
Bijectors
Auto Regressive Flows
In a recent google ai blog post an transformer based autoencoder is shown that can be used to learn and generate document layouts.
Tuesday, June 1, 2021
1 min
Ebook Hacks
hacks
ebooks
resolution
A number of djvu docs collected over a long time need to be convert them into pdf.
Saturday, May 29, 2021
2 min
Multilevel Models
NLP
notes
summarization task
lecture notes
bibliography
literature review
Different Multilevel Models Types
Sunday, May 16, 2021
9 min
Q&A and the Winograd schemas
idea
NLP
intelligence
resolution
The classical Q&A task is fairly easy to solve. But how well does the IR system understand/model the data. The challenge to test this aspect of the system is to provide test…
Tuesday, April 27, 2021
4 min
Automatic Summarization Task
NLP
notes
summarization task
lecture notes
bibliography
literature review
video
automatic extracting
automatic abstracting
sentence selection
document screening
sentence significance
relevance
content words
key words
pragmatic words
cue words
title words
sentence location
research methodology
parameterization
comparative evaluation
Concepts, slide commentaries and Lecture notes on Automatic text Summarization by Masa Nekic
Saturday, April 24, 2021
17 min
Bayesian agents
idea
game theory
bayesian games
sub-perfect bayesian equilibrium
Let’s try to define a KR framework for a Bayesian agent.
Wednesday, April 14, 2021
6 min
Modeling Events
modelling
data science
Modeling Events.
Friday, April 9, 2021
8 min
10 Tips To Improve Your Workflow
How to blog like a life-hacker.
Wednesday, April 7, 2021
3 min
Language Models Are Open Knowledge Graphs
paper review
paper
language models
deep learning
data mining
NLP
A review of the paper “Language Models are Open Knowledge Graphs” by Chenguang Wang, Xiao Liu, Dawn Song arXiv:2010.11967
Wednesday, April 7, 2021
7 min
Linkage 2021-04-07
links
Cleaning up my Tabs:
Wednesday, April 7, 2021
2 min
Jekyll take 3
Getting
blogging
ruby
jekyll
My attempts to get the jekyll version of this site to also build locally.
Sunday, April 4, 2021
3 min
MathJax 3 fix for Jekyll hosted on Github pages
blogging
jekyll
kramdown
mathjax
Issues and workarounds for MatchJax 3.0.
Sunday, April 4, 2021
2 min
Effective Approaches to Attention-based NMT
Paper review for the deeplearning.ai NLP specialization
nlp
coursera
notes
paper
attention
deep learning
literature review
Review of the paper on dot product attention for the deeplearning.ai NLP specialization.
Sunday, March 21, 2021
6 min
numpy melt down
python
macos
bugs
numpy melt down.
Sunday, November 29, 2020
1 min
Deep Learning Intuitions
intuition
data analysis
python
deep learning
Stacking n-layers RELUS in a feed forward neural network is functionally equivalent to a set of nested inequalities.
Sunday, October 25, 2020
2 min
brace expansion
bash
command line
linux
the bash shell supports brace expansion.
the idea is that the string before and after are concatenated with element in the braces
echo
"you won "
{two
,
three
,
four}
"…
Friday, June 12, 2020
1 min
Pandas Productivity Challenge?
data-science
python
data-wrangling
Just a little rant on Pandas various contexts
Wednesday, March 4, 2020
7 min
How to avoid cross site scripting (XSS) errors with the Jupyter local runtime for Colab
data-science
ds-tips
Google-colab
colab
jupyter
python
R
tool-tip
data analysis
XSS
So the trick is
Thursday, February 20, 2020
1 min
Docker for data science
docker
conternerization
data analysis
Post description
Sunday, November 24, 2019
1 min
Exploding and vanishing nodes.
brain farts
One paradgm is that the network could be dynamic. For such a model we want to be able to add and remove nodes. This could be an issue for networks that are engineered to…
Wednesday, July 31, 2019
2 min
text annotation with BRAT
BRAT is a rapid annotation tool. Its old no long maintained - the original developers seem to have moved on. Requests for RTL support have been largely ignored. Some…
Tuesday, January 16, 2018
1 min
A/B testing cost and risks?
PPC,
data science,
digital marketing,
quantitative marketing,
CRO,
experimental design,
A/B testing
A/B testing cost and risks and some recommendation.
Sunday, July 30, 2017
12 min
Travel checklist
life hacks for travel
travel
checklist
Check if you need a visa
Check if yout passport is valid
Take care of reimbursement - if any
break in walking shoes 3 weeks before travel
Check if you need vaccinations
book…
Wednesday, December 14, 2016
1 min
HotJar Heat Map Analysis - Dr. David Darmanin
All things data 2015
Conference
Analytics
Heat Maps
What are Heatmaps
Wednesday, April 20, 2016
2 min
Using Competitive Analysis to Benchmark Your Marketing Efforts Ariel Rosenstein - Similar Web
All things data 2015
all things data
conference
analytics
orgenizational behviour
Mr Jerbi’s Background: Come to web analytics from academia Industry and Management - Scheduling and QA. Recalls that before it was bought by Google Urchin cost…
Monday, April 20, 2015
2 min
Using Competitive Analysis to Benchmark Your Marketing Efforts - Ariel Rosenstein - Similar Web
All things data 2015
Marketing
Analytics
Competitive Analysis
Ari is the Sr. Marketing Director at Similarweb
Monday, April 20, 2015
1 min
Analytics Checklist
Desktop Design
Laptop Design
Tablet Design
Mobile Design
Mobile Opened Menu
Exit Popup Design
Validation Error Design
Saturday, February 7, 2015
2 min
life hacks
life
hacks
health
productivity
Health and supplements:
Friday, June 7, 2013
9 min
Text Mining With Python
a number of NLP tasks in Python
python
NLP
text mining
code
processing unknown tokens
Tuesday, November 29, 2011
6 min
Text Mining With R
a number of NLP tasks in R
R
NLP
text Mining
code
Computational Linguistics tasks:
Tuesday, November 29, 2011
3 min
Tidy Text Mining With R
an update on NLP with R
R
NLP
Text Mining
tidyverse
code
Computational Linguistics tasks:
Tuesday, November 29, 2011
9 min
Time management Tips
We could all use a productivity boost
time management
productivity
Effective time management is crucial for success in both personal and professional life. With the right approach, you can achieve more in less time while maintaining a healthy work-life balance
Thursday, August 11, 2011
3 min
No matching items