All Notes

 
Langtalks RSS
  • #43 - Building with GenAI-powered tools | Idan Benaun
    • Podcast with lots of tools, lots of crap to dig into.
    • Forms:
      • typeform
      • KaliFroms - “90% of type form for 50% less”
    • No…
    • Oren Bochman
    Thursday, April 3, 2025
     
    Base line Morphology Model
    So in this note I’d like to create a vanilla implementation of a morphology and syntax that might be used as a inductive bias for the emergent language.
    Oren Bochman
    Wednesday, April 2, 2025
     
    Research Questions
    Talking with some people today at BIU I get to realize that
    Oren Bochman
    Wednesday, April 2, 2025

    The roles of Partial pooling and mixed strategies in the Lewis signaling game
    Today I posit a couple of questions on the Lewis signaling game.
    Oren Bochman
    Tuesday, March 11, 2025

    Emergent Languages
    A working paper on emergent languages
    Oren Bochman
    Tuesday, January 14, 2025

    Planning in the Complex Lewis Game
    Today I want to consider a couple of weak assumption about planning in the Complex Lewis game. Yet before I do I ought to revisit the basic form of the Lewis Signaling game…
    Oren Bochman
    Tuesday, January 14, 2025

    The Referential Lewis Signaling Game
    When I read a few papers using the referential Lewis signaling game I thought, this should be much faster for complex signaling games I use in my research. But when I got to…
    Oren Bochman
    Tuesday, January 14, 2025

    A garden of forking paths
    I’ve been thinking how to visualize learning the complex lewis games.
    Oren Bochman
    Saturday, January 11, 2025

    Complex Signals Questions
    Question: how can we use planning in the Lewis Signaling Game.
    Oren Bochman
    Monday, January 6, 2025

    The Many Path To A Signaling System
    The Garden of Forking Paths — Jorge Luis Borges
    Oren Bochman
    Sunday, January 5, 2025

    Off-Policy Learning
    RL is full of big words like “off-policy learning” and “importance sampling”. If big words scare you, you are not alone. But most of the ideas in RL are simple and…
    Oren Bochman
    Saturday, January 4, 2025

    Rethinking Signaling systems via the lens of compositionality
    In (Skyrms 2010) the author discusses the evolution of signaling systems and the emergence of language as well as the role of compositionality in the emergence of language…
    Oren Bochman
    Thursday, January 2, 2025

    Lewis Signaling Game for PettingZoo
    The above is a basic version of the Lewis Signaling Game implemented in PettingZoo. The game consists of a sender and one or more receivers.
    Oren Bochman
    Wednesday, January 1, 2025

    Books, Courses Tools
    An Introduction to Statistical Learning by Gareth James, Daniela Witten, Trevor Hastie and Robert Tibshirani.
    Oren Bochman
    Wednesday, January 1, 2025

    Villeny pure and simple
    So much has been written about capone, and gangster movies here is a little note on character building in Noir. Noir characters were often minmal stereotypes, but some…
    Oren Bochman
    Thursday, December 12, 2024

    Misbehavior of Markets and Scaling in financial prices 1-4
    Review of Mandelbrot’s papers on scaling in financial prices and his popular science book The (Mis)behaviour of Markets.
    Oren Bochman
    Monday, December 2, 2024

    Scaling in financial prices 4
    “In the Brownian model, such a high level of concentration has a probability so minute that it should never happen. Unfortunately for the model, it happens every decade.”
    Oren Bochman
    Sunday, December 1, 2024

    Scaling in financial prices 3
    In the paper “Scaling in financial prices: III. Cartoon Brownian Motions in Multifractal Time” (Mandelbrot 2001) Mandelbrot continus his exploration of fractal and…
    Oren Bochman
    Saturday, November 30, 2024

    Scaling in financial prices 2
    In the paper “Scaling in financial prices: II. Multifractals and the star equation” (Mandelbrot 2001) Mandelbrot continus his exploration of financial price scaling. He…
    Oren Bochman
    Friday, November 29, 2024

    Scaling in financial prices 1
    “The ideal market completely disregards those spikes—but a realistic model cannot.”
    Oren Bochman
    Thursday, November 28, 2024

    Vitter’s Algorithm
    This is the Vitter algorithm - an algorithm for encoding and decoding messages based on using Huffman prefix codes.
    Oren Bochman
    Friday, October 11, 2024

    TL-DR rethinking 💭 topological alignment
    Recently, I’ve been revisiting an old idea about creating a topological model of alignment. The machine translation task has been solved largely by using deep learning…
    Oren Bochman
    Tuesday, October 1, 2024

    LLM the good the bad and the ugly
    Early when I saw the first text by gpt2 I was intrigued that some of the researchers that did not get access to the early model and had to re-create the model based on just…
    Oren Bochman
    Monday, September 30, 2024

    LLM and the missing link
    The missing link is my name for a set of agents that should be able to edit wikipedia or at least to significantly reduce the effort needed to contribute to wikipedia.
    Oren Bochman
    Saturday, September 28, 2024

    NLP with RL
    supervised and unsupervised models are great for most NLP tasks, yet both approaches have their limitations. Supervised models require labeled data, which is usually in…
    Oren Bochman
    Friday, September 27, 2024

    Deduction Evaluation
    goal create a deduction data-set for evaluating reasoning capabilities of a man and machine.
    Oren Bochman
    Thursday, September 26, 2024

    Fine-tune llm for Style and Grammar advice.
    LLMs are amazing - can I fine tune a state of the art LLM like Lama 3.1 with what I consider to be very high quality writing from my private library content to create a…
    Oren Bochman
    Wednesday, September 25, 2024

    Is compositionality overrated? The view from language emergence
    A review of Marco Baroni’s talk on the emergence of languages and the role of compositionality in language evolution.
    Oren Bochman
    Sunday, September 1, 2024
     
    Six quick tips to improve modeling
    The following tips are from (Gelman and Hill 2007) Data Analysis Using Regression and Multilevel/Hierarchical Models by Andrew Gelman and Jennifer Hill.
    Oren Bochman
    Monday, August 26, 2024

    Stumpy
    Stumpy (Law 2019) is a powerful and scalable library for computing a matrix profile which can be used for a variety of time series data mining tasks.
    Oren Bochman
    Thursday, August 8, 2024

    replay buffer questions
    we should aim to keep full options traces in the buffer
    Oren Bochman
    Tuesday, July 2, 2024

    two ideas on generalization
    The first idea comes from looking at regression and hyperparameter optimization tasks
    Oren Bochman
    Monday, July 1, 2024

    Mesa & RL
    Ifs we can store state, action, reward trajectories (to a file) this would facilitate
    Oren Bochman
    Tuesday, June 25, 2024
     
    zero inflated data
    Zero inflated data is a type of data that has a large number of zero values.
    Oren Bochman
    Sunday, June 23, 2024
     
    readings in rl
    A list of RL-papers and resources that I have read or plan to read.
    Oren Bochman
    Tuesday, June 18, 2024
     
    Hyperparameter Optimization
    one the idea is for a set of Hyperparameters to find the best one.
    Oren Bochman
    Thursday, June 13, 2024

    More Sugar please
    In Sugar ad Astra I covered some research questions I had about Sugarscape. Today I’d like to mediate on some ideas I have for extending sugarscape to make it more of…
    Oren Bochman
    Tuesday, June 11, 2024

    Risk-constrained Markov decision processes
    by Vivek Borkar and Rahul Jain
    Oren Bochman
    Tuesday, June 11, 2024

    Evolutionary Games and Population Dynamics Summary
    I’ve recently come across a book called “Evolutionary Games and Population Dynamics” by Josef Hofbauer and Karl Sigmund.
    Oren Bochman
    Sunday, May 12, 2024

    Roth Erev learning in Lewis signaling games
    I wish now to implement learning in the Lewis signaling game. In the book some reinforcement learning RL algorithms are presented in some detail and a few variations are…
    Oren Bochman
    Thursday, May 9, 2024

    Signals Experiment
    some refactoring ideas:
    Oren Bochman
    Tuesday, May 7, 2024

    ad hoc complex signaling systems
    A deep dive into the complex signaling systems
    Oren Bochman
    Sunday, May 5, 2024

    Shannon Game
    In this note I want to start to explore one of my notions of compositionality of Lewis games with another game. In my thinking currently consider at least three senses for…
    Oren Bochman
    Thursday, May 2, 2024

    Urn models using Numpy
    “There is a tendency in our planning to confuse the unfamiliar with the improbable. The contingency we have not considered seriously looks strange; what looks strange is…
    Oren Bochman
    Thursday, May 2, 2024

    RAD REPL
    TODO: 1. [x] basic REPL 2. [x] command based class 3. [x] add task command 4. [x] list tasks command 5. [x] set current task command 6. [x] complete task command
    Oren Bochman
    Wednesday, May 1, 2024

    Mesa Lessons
    Implementing Sugarscape has some interesting lessons.
    Oren Bochman
    Sunday, March 31, 2024

    Sugar Scapes
    Agent movement rule M:
    Oren Bochman
    Sunday, March 31, 2024
     
    OCR building blocks
    split into:
    Oren Bochman
    Thursday, March 28, 2024

    Patric Winston

    A definition by Patrick Henry Winston
    Patrick Henry Winston provides a definition of AI. How he keeps expanding his definition as he goes along is thing of beauty. It expands organicaly to incorporate new ideas…
    Oren Bochman
    Sunday, March 3, 2024
     
    OCR - Brain Dump
    Working of OCR articles by Susmith Reddy
    Oren Bochman
    Sunday, February 25, 2024

    Rhetoric NLP Tasks
    I recently have been annotating speeches following up on the edx a course on Rhetoric.
    Oren Bochman
    Saturday, February 17, 2024

    mermaid logo

    😁 Quarto 💖 Mermaid🧜 Mindmaps 🧠
    Quarto at last supports Mindmap charts using Mermaid charts.
    Oren Bochman
    Monday, February 12, 2024

    Lewis Game from a Bayesian Perspective
    Some thoughts on the Lewis signaling game
    Oren Bochman
    Monday, February 12, 2024

    man standing beside pipes by Kaique Rocha

    The Great Migration
    some migration notes from Blooger to Jekyl to Quarto blog.
    Oren Bochman
    Tuesday, January 30, 2024

    Post With Code
    This is an obligatory post with executable code.
    Oren Bochman
    Sunday, January 28, 2024

    SuperLearner
    SuperLearner is an ensambeleing library.
    Oren Bochman
    Wednesday, January 10, 2024

    Engineering Reinforcement Learning Algorithms
    As I progressed though the RL specialization I came to realize that the research is mostly about coming up with a new algorithm that works better. This is tricky and so in…
    Oren Bochman
    Wednesday, January 10, 2024

    Understanding Emergent Languages
    Okay after taking a break, today I’ve been rethinking Complex Lewis signaling systems and the equilibria. I slow make progress in this area by considering a number of…
    Oren Bochman
    Thursday, January 4, 2024

    D3.js in in Quarto Observable
    So I’ve migrated my sample to Quarto – which supports d3.js via Observable and without the need for whack hacks
    Oren Bochman
    Tuesday, January 2, 2024

    AutoGluon Cheetsheets
    Autogluon is a auto-ml framework, here are three cheetsheet for accellerating data science workloads
    Oren Bochman
    Wednesday, December 20, 2023
     
    Summary: Synthesis and Stabilization of Complex Behaviors through Online Trajectory Optimization
    This paper was referenced by Drew Bagnell in the Coursera RL specilization for using simple quadratic approximation to learn a model in a continous control setting. The…
    Oren Bochman
    Thursday, June 1, 2023
     
    Spark Tips
    https://stackoverflow.com/questions/30245180/what-do-the-numbers-on-the-progress-bar-mean-in-spark-shell#:~:text=This%20progress%20indicator%20means%20that,number%20of%20task…
    Oren Bochman
    Thursday, June 1, 2023
     
    MCMC algorithms
    The procedure MetropolisHastings takes as input : - the target distribution p(x), - the proposal distribution q(x,y), - the initial sample x_0, and - the total number of…
    Oren Bochman
    Saturday, April 22, 2023
     
    Quarto loves pseudocode
    \begin{algorithm} \caption{Quicksort} \begin{algorithmic} \Procedure{Quicksort}{$A, p, r$} \If{$p < r$} \State $q = $ \Call{Partition}{$A, p, r$} \State…
    Oren Bochman
    Tuesday, April 11, 2023

    slide

    Text2topic Leverage reviews data for multi-label topics classification in Booking.com
    Having millions of customer reviews, we would like to better understand them and leverage this data for different use cases. For example, finding popular activities per…
    Oren Bochman
    Tuesday, February 28, 2023

    slide

    Validating NLP data and models
    NLP data, and unstructured data in general, is very hard to validate. Validating NLP data is a real challenge, as actions such as statistical analysis and segmentation…
    Oren Bochman
    Tuesday, February 28, 2023
     
    Transformations in Linguistic Representation
    In computational linguistics, using different representations can shed light on the structure of language. I’m considering how sentences can be depicted using parse trees or…
    Oren Bochman
    Wednesday, February 22, 2023
     
    event generator
    fake data
    Oren Bochman
    Thursday, February 16, 2023

    OLS regression From Scratch
    OLS regression is a method for estimating the parameters of a linear regression model. The goal is to find the line that best fits a set of data points. The line is…
    Oren Bochman
    Wednesday, February 1, 2023
     
    entropy for uncertainty quantification
    There is an e-commerce store. Every day it collects the cost, sales and shelf price for each product. Let’s say we also have to deduct a sales tax or value added tax say at…
    Oren Bochman
    Thursday, September 22, 2022

    wikisym 2012 logo

    Wikisym 2012
    Due to a kind grant by the WikiMedia Foundation I was able to attend Wikisym 2012 in Linz Austria what follows is my report on the event.
    Oren Bochman
    Tuesday, July 26, 2022
     
    Set Up M1 MacBooks for DS & ML
    Set Up M1 MacBooks for DS & ML
    Oren Bochman
    Thursday, May 5, 2022
     
    command line
    command line cheea sheet macos + zsh + git
    Oren Bochman
    Thursday, May 5, 2022

    Meme bank
    A meme is an idea, behavior, style, or usage that spreads from person to person within a culture. A meme bank would be a zoo for cataloging and breeding memes.
    Oren Bochman
    Thursday, December 30, 2021

    Getting more from your agency ?
    Getting more from your digital marketing agency, my five cents on picking your agency.
    Oren Bochman
    Monday, September 27, 2021

    Excel 2019 for Marketing Statistics in pandas
    Excel 2019 for Marketing Statistics in pandas
    Oren Bochman
    Friday, September 24, 2021

    Language models and explainability
    Language models and explainability
    Oren Bochman
    Friday, September 24, 2021

    Attention for sensor fusion
    Attention for sensor fusion
    Oren Bochman
    Friday, September 24, 2021

    Storytelling and other essentials
    Storytelling and other essentials,
    Oren Bochman
    Thursday, September 2, 2021

    Stochastic Gradient Descent - The good parts
    Stochastic Gradient Descent - The good parts
    Oren Bochman
    Sunday, August 29, 2021

    WaveNet
    The WaveNet paper is kind of old. Yet it seems to come up in various contexts. Some thoughts on this.
    Oren Bochman
    Sunday, August 29, 2021

    Python Graphs
    Python Graph Cookbook
    Oren Bochman
    Sunday, August 29, 2021

    What is in a citation?
    Creating Citation Web Components
    Oren Bochman
    Sunday, August 29, 2021

    Hackathon session link dumps & notes
    Wikipedia Hackathon notes
    Oren Bochman
    Friday, August 13, 2021

    Inlining Citations for Wikipedia articles
    An algorithm for Inlining Citations for Wikipedia articles.
    Oren Bochman
    Friday, August 13, 2021

    Transfer learning in NLP
    Transfer learning in NLP
    Oren Bochman
    Thursday, August 12, 2021

    A type of Witness and an evolving Idiom
    writing better code = writing more readable code.
    Oren Bochman
    Wednesday, July 14, 2021
     
    json-ld
    I’ve been excited about JSON-LD, when it came out as it offered a much cleaner way to do SEO. However It dawned on me later that it is also a geat format to worked with…
    Oren Bochman
    Thursday, July 1, 2021

    TensorFlow probability
    In a recent google ai blog post an transformer based autoencoder is shown that can be used to learn and generate document layouts.
    Oren Bochman
    Tuesday, June 1, 2021

    Ebook Hacks
    A number of djvu docs collected over a long time need to be convert them into pdf.
    Oren Bochman
    Saturday, May 29, 2021

    Multilevel Models
    Different Multilevel Models Types
    Oren Bochman
    Sunday, May 16, 2021

    Q&A and the Winograd schemas
    The classical Q&A task is fairly easy to solve. But how well does the IR system understand/model the data. The challenge to test this aspect of the system is to provide test…
    Oren Bochman
    Tuesday, April 27, 2021

    Automatic Summarization Task
    Concepts, slide commentaries and Lecture notes on Automatic text Summarization by Masa Nekic
    Oren Bochman
    Saturday, April 24, 2021

    Bayesian agents
    Let’s try to define a KR framework for a Bayesian agent.
    Oren Bochman
    Wednesday, April 14, 2021

    Modeling Events
    Modeling Events.
    Oren Bochman
    Friday, April 9, 2021

    Language Models Are Open Knowledge Graphs
    A review of the paper “Language Models are Open Knowledge Graphs” by Chenguang Wang, Xiao Liu, Dawn Song arXiv:2010.11967
    Oren Bochman
    Wednesday, April 7, 2021

    Linkage 2021-04-07
    Cleaning up my Tabs:
    Oren Bochman
    Wednesday, April 7, 2021

    10 Tips To Improve Your Workflow
    How to blog like a life-hacker.
    Oren Bochman
    Wednesday, April 7, 2021

    Jekyll take 3
    My attempts to get the jekyll version of this site to also build locally.
    Oren Bochman
    Sunday, April 4, 2021

    MathJax 3 fix for Jekyll hosted on Github pages
    Issues and workarounds for MatchJax 3.0.
    Oren Bochman
    Sunday, April 4, 2021

    Effective Approaches to Attention-based NMT
    Review of the paper on dot product attention for the deeplearning.ai NLP specialization.
    Oren Bochman
    Sunday, March 21, 2021

    numpy melt down
    numpy melt down.
    Oren Bochman
    Sunday, November 29, 2020

    Deep Learning Intuitions
    Stacking n-layers RELUS in a feed forward neural network is functionally equivalent to a set of nested inequalities.
    Oren Bochman
    Sunday, October 25, 2020
     
    brace expansion
    • the bash shell supports brace expansion.
    • the idea is that the string before and after are concatenated with element in the braces
    echo "you won "{two,three,four}"…
    Oren Bochman
    Friday, June 12, 2020

    Pandas Productivity Challenge?
    Just a little rant on Pandas various contexts
    Oren Bochman
    Wednesday, March 4, 2020

    How to avoid cross site scripting (XSS) errors with the Jupyter local runtime for Colab
    So the trick is
    Oren Bochman
    Thursday, February 20, 2020

    Docker for data science
    Post description
    Oren Bochman
    Sunday, November 24, 2019
     
    Exploding and vanishing nodes.
    One paradgm is that the network could be dynamic. For such a model we want to be able to add and remove nodes. This could be an issue for networks that are engineered to…

    Oren Bochman
    Wednesday, July 31, 2019

    text annotation with BRAT
    BRAT is a rapid annotation tool. Its old no long maintained - the original developers seem to have moved on. Requests for RTL support have been largely ignored. Some…
    Oren Bochman
    Tuesday, January 16, 2018

    A/B testing cost and risks?
    A/B testing cost and risks and some recommendation.
    Oren Bochman
    Sunday, July 30, 2017

    Travel checklist
    • Oren Bochman
    Wednesday, December 14, 2016
     
    HotJar Heat Map Analysis - Dr. David Darmanin
    What are Heatmaps
    Oren Bochman
    Wednesday, April 20, 2016
     
    Using Competitive Analysis to Benchmark Your Marketing Efforts Ariel Rosenstein - Similar Web
    Mr Jerbi’s Background:       Come to web analytics from academia Industry and Management - Scheduling and QA.       Recalls that before it was bought by Google Urchin cost…
    Oren Bochman
    Monday, April 20, 2015
     
    Using Competitive Analysis to Benchmark Your Marketing Efforts - Ariel Rosenstein - Similar Web
    Ari is the Sr. Marketing Director at Similarweb
    Oren Bochman
    Monday, April 20, 2015
     
    Analytics Checklist
    Oren Bochman
    Saturday, February 7, 2015
     
    life hacks
    Health and supplements:
    Oren Bochman
    Friday, June 7, 2013

    Text Mining With Python
    processing unknown tokens
    Oren Bochman
    Tuesday, November 29, 2011

    Text Mining With R
    Computational Linguistics tasks:
    Oren Bochman
    Tuesday, November 29, 2011

    Tidy Text Mining With R
    Computational Linguistics tasks:
    Oren Bochman
    Tuesday, November 29, 2011

    Photo by Pixabay

    Time management Tips
    Effective time management is crucial for success in both personal and professional life. With the right approach, you can achieve more in less time while maintaining a…
    Oren Bochman
    Thursday, August 11, 2011
    No matching items