In (Skyrms 2010) philosopher and mathematician Brian Skyrms discusses how one can extend the concept of a signaling games into a full fledged signaling systems and to some extent a rudimentary language.

I like many other found Signals to be a fascinating little book worth reading at least a couple of times. While Skyrms starts with a basic exposition motivated by Greek philosophers he eventually makes a deep dive into areas like reinforcement learning, replicator dynamics, mean field games and some other deep mathematical fields without much of introduction. In places the monographs seems incomplete and may require hunting the papers in the bibliography and possibly more recent work by the same authors.

I slowly noticed it being cited in more and more papers which I read. This sort of indicated that intellectually more people we on the same path of thinking how to equip their problem solving with a signaling system or better yet to evolve a more sophisticated language.

I went back several times to review the chapter on Complex signals, which I feel is the most interesting for real-world application. I began to think that the Lewis games are too rudimentary since signaling systems that evolve/learned from them are basically n-k maps of signals to meaning.

What I wanted was a recipe for quickly agent that need to evolve and teach/learn a language for efficient communication.

I wanted to go the relevant papers he covers on this area and then to see of there were newer results he did not cover. This turned out to be a bit of a challenge. In the mean time I also learned some courses on RL and even tried a couple of ideas from this book at work. I think I should summarize at least some of the more interesting results from the book.

Besides a summary I also want to try to implement some of the keystone models in the book to see if I can derive the reductionist simple language learning game.

1. Signals

Big Research Questions

Q1. How can interacting individuals spontaneously learn to signal?

Q2. How can species spontaneously evolve signaling systems?

Sender-Receiver

There are two players, the sender and the receiver.
Nature chooses a state at random and the sender observes the state chosen.
The sender then sends a signal to the receiver, who cannot observe the state directly but does observe the signal.
The receiver then chooses an act, the outcome of which affects them both, with the payoff depending on the state.
Both have pure common interest—they get the same payoff—and there is exactly one “correct” act for each state.
In the correct act-state combination they both get positive payoff; otherwise payoff is zero.
The simplest case is one where there are the same number of states, acts, and signals.

A separating equilibrium is called a signaling system

If we start with a pair of sender and receiver strategies, and switch the messages around the same way in both, we get the same payoffs. In particular, permutation of messages takes one signaling-system equilibrium into another.

We can understand a signaling system as a encoding look-up table by the sender and a decoding lookup table for the reciever which is the inverse of the first. The product of two permutations is the identity matrix. Each permutation of the identity matrix gives a valid signaling system

Q3. Is there a most salient signaling system?

Salience is a concept from Schelling’s Game theory that suggest that one solution to a coordination problem might be naturally better then others. (e.g. meeting a relative at the airport). This can be due to an externality to the pure coordination problem. Salience can also arise from non uniformity of the state distribution - by providing less frequent messages longer messages based on binary coding. The salience hierarchy might be grounded in risk - more urgent messages might be shorter and learned before the longer ones.

my thoughts on Salience:

Salience would arise in nature through the non-uniform distribution of states which is ignored in most papers leading to equally salient signaling system. When the states are not uniformly distributed then the signals will not be uniformly distributed. The more common states should have more common signals. e.g. if snakes are more common than eagles then the signal for snake should be shorter/simpler/learned first than the signal for eagle. In another location the distributions could be reversed leading to a different salience hierarchy.
Another way (of seeing this is that) salience would arise in nature to minimize risks for the sender, who could become a target for a predator by sending a signal.
Two other source of salience are the risk of making mistakes and the cost of sending a signal.
Finally there is nothing stopping the salience from being a function of all these factors through a product of their probabilities. Though this is more easily expressed in the language of fitness. Salience will select the language whose speakers gain the highest expected progeny (fitness) by avoiding risks, conserving energy and avoiding miscommunication for their habitat.
If the speakers migrate they might benefit from a language that is salient in multiple habitats. This is a form of generalization.
If there are different cost for encoding and decoding then the salience will be a function of the product of the encoding and decoding costs. This is a form of cost minimization. In this scenario there may be a competition between the sender and the receiver to minimize their costs. But the sender has the upper hand since the sender chooses the signal. The sender is the causal agent in the signaling system.

Q4. How can two agents with different signaling find a SS that is midway between them (including systems with both shared and unique states)?

Its fairly clear that under the rules of the Lewis game all valid signaling systems are isomorphic and none are more salient.
In nature salience might arise and a systems leading to greatest fitness in its users would be the most salient.
To find a signaling system that is midway between two signaling systems we could use the Cayley distance between the two permutations. This is the minimum number of transpositions required to transform one permutation into another. The median permutation would be the one that has half the Cayley distance to each signaling systems.
If the systems have salience we may want to also keep the most salient signals intact and now we have a more complex optimization problem. We could use the KL divergence between the two signaling systems to estimate the distance of the signaling distribution from a separating distribution.

the Cayley distance between two permutations is the minimum number of transpositions required to transform one permutation into another. it is a metric on the symmetric group.

Information in signals

Q5. How can we minimally extend this framework to handle Errors and Deception

Signals carry information. The natural way to measure the information in a signal is to measure the extent that the use of that particular signal changes probabilities. Accordingly, there are two kinds of information in the signals in Lewis sender-receiver games: information about what state the sender has observed and information about what act the receiver will take. The ﬁrst kind of infor- mation measures effectiveness of the sender’s use of signals to discriminate states; the second kind measures the effectiveness of the signal in changing the receiver’s probabilities of action.

TODO: estimate information content of each signal for sender and receiver for separating and partial pooling cases
TODO: use entropy for message level estimates of sender and receiver under separating signal, a synonym, a homonym.
TODO: use entropy KL divergence to estimate a the distance of the signaling distribution from a separating distribution.

Actually there are a number of extensions one would like to consider for the Lewis framework:

bottlenecks
1. more state than signals - this is the interesting case and where complex signaling systems should arise
2. more signals than states - this is the case where synonyms can arrise
basic logical reasoning, conjunctions, disjunctions, negations
multiple senders and or receivers
1. rewarding coordination (each state requires different actions from the agents - they are learning different receiver maps )
2. rewarding correlated equilibrium (sender lets the receivers pick from correlated states at random allowing the receivers avoid penalty of miscoordination.)
3. networks of agents per the goyal model in ch 11 and 13

complex signals

conjunction of signals,
ordered signals,
recursive signals, group

Evolution

We first see two competing Signaling systems being tested in a population

(Hofbauer and Sigmund 1998) Population dynamics - can be used to identify which dynamic equlibria are stable or unstable given an intial population of strategies

Hofbauer, J., and K. Sigmund. 1998. Evolutionary Games and Population Dynamics. Cambridge University Press. https://books.google.co.il/books?id=Xu-H0ClCHN8C.

There is a figure showing the field dynamics with basins of attractions arrising from the population dynamics equations

We also see symmetry breaking selecting a signaling system to a system

\frac{dp(A)}{dt}=p(A)[U(A)-U]

where

U(A) is the average payoff to strategy A and
U is the average payoff in the population.

from pylab import *

alpha, beta = 1, 1
xvalues, yvalues = meshgrid(arange(0, 2.1, 0.1), arange(0, 2.1, 0.1))
xdot = xvalues * alpha - beta
ydot = yvalues * alpha - beta
streamplot(xvalues, yvalues, xdot, ydot)
show()

we have a discussion of how signals might arise.

Evolution

import itertools
import functools
from mesa import Agent, Model
from mesa.time import StagedActivation, RandomActivation
from mesa.datacollection import DataCollector
import matplotlib.pyplot as plt

# agent_roles
r_nature = 'nature'
r_sender = 'sender'
r_receiver = 'receiver'

Lewis Signaling Game Model

The Lewis signaling game is a model of communication between two agents, a sender and a receiver. Nature picks a state, the sender observes the state, chooses a signal, and sends the signal to the receiver who then takes an action based on the signal. If the action of the receiver is a match with the state obseved by the sender, agents get a reward of 1, otherwise, they get a reward of 0. state, the sender and receiver get a reward of 1, otherwise, they get a reward of 0. is a match with the state, the sender and receiver get a reward of 1, otherwise, they get a reward of 0.

class HerrnsteinRL():
    '''
                                    The Urn model
     nature            sender                 reciever     reward
                       
    | (0) | --{0}-->  | (0_a)  | --{a}--> | (a_0) | --{0}-->   1   
    |     |           | (0_b)  | --{b}    | (a_1) | --{1}-->   0
    |     |           +--------+    | +-->+-------+
    |     |                         +-|-+  
    | (1) | --{1}-->  | (1_a)  | --{a}+ +>| (b_0) | --{1}-->   1
    |     |           | (1_b)  | --{b}--->| (b_1) | --{0}-->   0
    +-----+           +--------+          +-------+
    
    
    Herrnstein Urn algorithm
    ------------------------
    
    1. nature picks a state 
    2. sender gets the state, chooses a signal by picking a ball in choose_option() from the stat'es urn
    3. reciver gets the action, chooses an actuion by picking a ball in choose_option()
    4. the balls in the urns are incremented if action == state
    5. repeat
    
    '''
    def __init__(self, options, learning_rate=1.0,verbose=False,name='Herrnstein matching law', balls=None):
        
        # filter options in choose option by input
        self.verbose = verbose
        self.name=name
        self.learning_rate = learning_rate
        self.options = options
        if balls is not None:
          self.balls = balls
        else:
          self.balls = {option: 1.0 for option in self.options}
        if self.verbose:
          print(f'LearningRule.__init__(Options: {options})')
    
    def get_filtered_urn(self, filter):
      ''' filters urn's options by prefix and normalizes the weights
          usege:
          urn=urn.get_filtered_urn(1)
          choice = model.random.choice(list(urn.keys()), p=list(urn.values()))
      '''
      assert type(filter) == int, f"filter must be a int"
      filtered_options = [key for key in self.balls.keys() if key[0] == filter]
      if not filtered_options:
        raise ValueError(f"No options found with filter {filter}")
      if self.verbose:
        print(f"in get_filtered_urn({filter=}) --- filtered_options: {filtered_options=}")
      filtered_balls = {opt: self.balls[opt] for opt in filtered_options}
      if self.verbose:
        print(f"in get_filtered_urn({filter=}) --- filtered_balls: {filtered_balls=}")
      total = functools.reduce(lambda a,b: a+b, filtered_balls.values())
      #total = sum(filtered_balls.values())
      if self.verbose:
        print(f"in get_filtered_urn({filter=}) --- total: {total=}")
      assert total > 0.0, f"total weights is {total=} after {filter=} on {self.balls}"      
      normalized_balls = {option: weight / total for option, weight in filtered_balls.items()}
      if self.verbose:
        print(f"in get_filtered_urn({filter=}) --- returning : {normalized_balls=}")
      return normalized_balls
     
    def choose_option(self,filter,random):
        ''' chooses an option from the urn based on the filter and the random choice
            
            usage:
            urn.choose_option(filter=1,random=model.random)
        '''
       
        urn = self.get_filtered_urn(filter)
        if random:
          options = random.choices(list(urn.keys()), weights=list(urn.values()),k=1)
          option = options[0]
          
          if self.verbose:
            print(f'in HerrnsteinRL.choose_option({filter=}) --- chose {option=} from {urn=}')

          return option
        else:
          raise Exception(f"random must be a random number generator")
        
    def update_weights(self, option, reward):
        old_balls = self.balls[option]
        self.balls[option] += self.learning_rate * reward 
        if self.verbose:
          print(f"Updated weight for option {option}: {old_balls} -> {self.balls[option]}")

class LewisAgent(Agent):
  
    def __init__(self, unique_id, model, game, role, verbose=False):
        super().__init__(unique_id, model)
        self.role = role #( one of nature, sender, receiver)
        self.verbose = verbose
        self.game = game
        self.messages = []
        self.actions = []
        if role == "sender":
          self.urn = HerrnsteinRL(model.states_signals, learning_rate=1.0,verbose=verbose,name='state_signal_weights')
        elif role == "receiver":
          self.urn = HerrnsteinRL(model.signals_actions, learning_rate=1.0,verbose=verbose,name='signal_action_weights')
        else:
          self.urn = None
        
    def step(self):
      # reset agent state before step
      self.messages = []
      self.actions = []

    def gen_state(self)-> None:
        if self.role == r_nature:
          self.current_state = model.random.choice(self.model.states)
          if self.verbose:
                print(f"Nature {self.unique_id} set state {self.current_state}")
                
    @property
    def state(self):
        if self.role == r_nature:
          return self.current_state

    def choose_signal(self, filter):
        # sanity checks for filter
        assert type(filter) == int, f"filter must be a int"
        assert filter in model.states, f"filter must be a valid state"
        
        
        if self.role != r_sender:
          throw(f"Only sender can send signals")
        self.option = self.urn.choose_option(filter=filter,random=self.model.random)
        signal = self.option[1] # the prefix is the urn context we want the suffix
        assert type(signal) == int, f"signal {signal=} must be a int"
        self.signal = signal
        if self.verbose:
              print(f"Sender {self.unique_id} got filter {filter} choose option: {self.option} and signaled: {self.signal}")
        return self.signal
          

    def send_signal(self, filter, receiver):
        ''' 
            # Message sending logic:
            1. sender chooses a signal based on the state
            2. sender sends the signal to the receiver
        '''
        if self.role != r_sender:
          raise Exception(f"Only sender can send signals")
         
        assert type(filter) == int, f"filter must be a int"
        assert filter in model.states, f"filter must be a valid state"
        signal = self.choose_signal(filter=filter)
        assert signal is not None, f"signal must be a valid signal"
        if self.verbose:
          print(f"Sender {self.unique_id} chose signal: {signal}")
        receiver.messages.append(signal)
        if self.verbose:
          print(f"Sender {self.unique_id} sends signal: {signal} to receiver {receiver.unique_id}")

    def fuse_actions(self,actions):
        ''' 
            # Message fusion logic:
            1. single message:  if there is only one signal then the action is the action associated with the signal
            2. ordered messages: if there are multiple signals then the action is the number from the string assocciated with the concatenated signal
               if there are two signals possible per message we concat and covert binary string to number
            3. is the messages are sets we could perform a intersetion and take the action associated with the intersection 
               currently this is not implemented
            4. support for recursive signals is currently under research .
        ''' 
        if self.role != r_receiver:
          raise Exception(f"Only receiver can set actions")
        
        if len(actions) == 1: # single action no need to fuse
          return actions[0]
        else:
          # fuse the actions into a binary number
          action = 0
          # if there are multiple signals
          for i in range(len(actions)):
            action += actions[i]*(2**i)
          if self.verbose:
              print(f"Receiver {self.unique_id} fused actions : {self.actions} into action: {action}")
          return action

    def decode_message(self,signal):
        ''' first we need to get the filtered urn for the signal
            and then choose the option based on the urn'''
        if self.role != r_receiver:
          raise Exception(f"Only receiver can decode messages")
        option = self.urn.choose_option(filter=signal,random=self.model.random)
        action = option[1]
        if self.verbose:
              print(f"in decode_message({signal=}) Receiver {self.unique_id} got option: {option} and decoded action: {action}")
        return action

    def set_action(self):
        ''' first we need to use the urn to decode the signals 
            then need to fuse them to get the action '''
        if self.role != r_receiver:
          raise Exception(f"Only receiver can set the action")
        self.actions = []
        for signal in self.messages:
          self.actions.append(self.decode_message(signal))          
        self.action = self.fuse_actions(self.actions)
        # which option to reinforce 
        self.option = (self.messages[0],self.action)
        if self.verbose:
              print(f"Receiver {self.unique_id} received signals: {self.messages} and action: {self.action}")
              
    def set_reward(self,reward):
        if self.role not in [r_receiver,r_sender]:
          raise Exception(f"Only sender and receiver can set rewards")
        self.reward = reward
        if self.verbose:
            print(f"Receiver {self.unique_id} received reward: {self.reward}")
                
    def calc_reward(self,correct_action):
        if self.role != r_receiver:
          raise Exception(f"Only receiver can calculate rewards")
        self.reward = 1 if self.action == correct_action else 0        

class SignalingGame(Model):
  
    # TODO: add support for 
    # 1. bottle necks
    # 2. rename k to state_count
    # 3. state_per_sender = state_count/sender_count 
    # 2. partitioning states by signals => state/sender_count

    def __init__(self, game_count=2, senders_count=1, recievers_count=1, state_count=3,signal_count=3,verbose=True):
        super().__init__()
        self.verbose = verbose
        self.step_counter = 0
        self.schedule = RandomActivation(self)
        
        
        # Define the states, signals, and actions
        self.states   = [i for i in range(state_count)]
        print(f'{self.states=}')
        self.signals  = [i for i in range(signal_count)]
        print(f'{self.signals=}')
        self.actions  = [i for i in range(state_count)]
        print(f'{self.actions=}')
        
        # e.g., 1 -> 1, 2 -> 2, ...
        self.states_signals =  [(state,signal) for state in self.states for signal in self.signals]
        print(f'{self.states_signals=}')
        self.signals_actions = [(signal,action) for signal in self.signals for action in self.actions] 
        print(f'{self.signals_actions=}')
        
        # Agents

        self.uid=0
        self.senders_count=senders_count
        self.recievers_count=recievers_count

        # Games each game has a nature, senders and receivers
        self.games = []
        # Create games        
        for i in range(game_count):
            game = {
              r_nature: None,
              r_sender: [],
              r_receiver: []
            }
            
            # create nature agent
            game[r_nature] = LewisAgent(self.uid, self, game=i,role = r_nature,verbose=self.verbose)
            self.schedule.add(game[r_nature])
            self.uid += 1
            
            # create sender agents
            for j in range(senders_count):
                sender = LewisAgent(self.uid, self, game=i,role = r_sender,verbose=self.verbose)
                game[r_sender].append(sender)
                self.schedule.add(sender)
                self.uid +=1
                
            # create receiver agents
            for k in range (recievers_count):
                reciever = LewisAgent(self.uid, self, game=i,role = r_receiver,verbose=self.verbose)
                game[r_receiver].append(reciever)
                self.schedule.add(reciever)
                self.uid +=1
                
            self.games.append(game)

            self.total_reward = 0
        

        # Define what data to collect
        self.datacollector = DataCollector(
            model_reporters={"TotalReward": lambda m: m.total_reward},  # A function to call 
            agent_reporters={"Reward": "reward"}  # An agent attribute
        )

    def compute_total_reward(self,model):
        return 
        
    def step(self):
      
        for agent in model.schedule.agents:
            # reset agent state before step
            agent.step()
            
        for game_counter, game in enumerate(self.games):
            if self.verbose:
                print(f"--- Step {model.step_counter} Game {game_counter} ---")
            nature = game[r_nature]
            nature.gen_state()
            state = nature.current_state
            assert type(state) == int, f"state must be a int"
            assert state in model.states, f"state must be a valid state"
            if self.verbose:
                print(f"in model.step() --- game {game_counter} --- Nature {agent.unique_id} set state {state} in game {game_counter}")
            for sender in game[r_sender]:
                for receiver in game[r_receiver]:                    
                    sender.send_signal(filter = state, receiver=receiver)
            for receiver in game[r_receiver]:
                assert receiver.role == r_receiver, f"receiver role must be receiver not {receiver.role}"
                receiver.set_action()
                if self.verbose:
                    print(f"in model.step() --- game {game_counter} --- Receiver {receiver.unique_id} action: {receiver.action}")
                receiver.calc_reward(correct_action=state)
                reward = receiver.reward
                assert type(reward) == int, f"reward must be a int not {type(reward)}"
                assert reward in [0,1], f"reward must be 0 or 1 not {reward}"
                print(f"in model.step() --- game {game_counter} --- Receiver {receiver.unique_id} received reward: {receiver.reward}")
            
            for agent in itertools.chain(game[r_sender],game[r_receiver]):
                agent.set_reward(reward)
                if self.verbose:
                    print(f"in model.step() --- game {game_counter} --- Sender {agent.unique_id} received reward: {reward}")
                agent.urn.update_weights(agent.option, reward)

            #print(f'in model.step() --- game {game_counter}, {self.expected_rewards(game)=}')
                    # Collect data
        
        self.total_reward += sum(agent.reward for agent in self.schedule.agents if agent.role == r_receiver)

        self.datacollector.collect(self)


    def expected_rewards(self,game):
      return 0.25

    def run_model(self, steps):

        """Run the model until the end condition is reached. Overload as
        needed.
        """
        while self.running:
            self.step()
            steps -= 1
            if steps == 0:
                self.running = False

# Running the model
state_count= 3  # Number of states, signals, and actions
signal_count= 3
steps = 1000

model = SignalingGame(senders_count=1,recievers_count=1,state_count=state_count,signal_count=signal_count,verbose=True,game_count=2)
model.run_model(steps)  # Run the model for the desired number of steps

# Get the reward data
reward_data = model.datacollector.get_model_vars_dataframe()

# Plot the data
plt.figure(figsize=(10, 8))
plt.plot(reward_data['TotalReward'])
plt.xlabel('Step')
plt.ylabel('Total Reward')
plt.title('Total Reward over Time')
plt.grid(True)  # Add gridlines
plt.xlim(left=0)  # Start x-axis from 0
plt.ylim(bottom=0,top=1000)  # Start y-axis from 0
plt.show()

self.states=[0, 1, 2]
self.signals=[0, 1, 2]
self.actions=[0, 1, 2]
self.states_signals=[(0, 0), (0, 1), (0, 2), (1, 0), (1, 1), (1, 2), (2, 0), (2, 1), (2, 2)]
self.signals_actions=[(0, 0), (0, 1), (0, 2), (1, 0), (1, 1), (1, 2), (2, 0), (2, 1), (2, 2)]
LearningRule.__init__(Options: [(0, 0), (0, 1), (0, 2), (1, 0), (1, 1), (1, 2), (2, 0), (2, 1), (2, 2)])
LearningRule.__init__(Options: [(0, 0), (0, 1), (0, 2), (1, 0), (1, 1), (1, 2), (2, 0), (2, 1), (2, 2)])
LearningRule.__init__(Options: [(0, 0), (0, 1), (0, 2), (1, 0), (1, 1), (1, 2), (2, 0), (2, 1), (2, 2)])
LearningRule.__init__(Options: [(0, 0), (0, 1), (0, 2), (1, 0), (1, 1), (1, 2), (2, 0), (2, 1), (2, 2)])
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 1.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=3.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
Sender 1 got filter 2 choose option: (2, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 1.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=3.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in decode_message(signal=2) Receiver 2 got option: (2, 0) and decoded action: 0
Receiver 2 received signals: [2] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 2): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 0): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=3.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 1.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=3.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in decode_message(signal=2) Receiver 5 got option: (2, 2) and decoded action: 2
Receiver 5 received signals: [2] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 2): 1.0 -> 1.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 2): 1.0 -> 1.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=3.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 1.0}
in get_filtered_urn(filter=1) --- total: total=3.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3333333333333333, (1, 1): 0.3333333333333333, (1, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.3333333333333333, (1, 1): 0.3333333333333333, (1, 2): 0.3333333333333333}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 1.0 -> 2.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 1.0 -> 2.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 1.0}
in get_filtered_urn(filter=1) --- total: total=3.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3333333333333333, (1, 1): 0.3333333333333333, (1, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.3333333333333333, (1, 1): 0.3333333333333333, (1, 2): 0.3333333333333333}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=3.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 1.0 -> 2.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 1.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 1.0}
in get_filtered_urn(filter=1) --- total: total=3.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3333333333333333, (1, 1): 0.3333333333333333, (1, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.3333333333333333, (1, 1): 0.3333333333333333, (1, 2): 0.3333333333333333}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 1.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=3.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in decode_message(signal=2) Receiver 2 got option: (2, 2) and decoded action: 2
Receiver 2 received signals: [2] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (1, 2): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 2): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 2.0, (1, 1): 1.0, (1, 2): 1.0}
in get_filtered_urn(filter=1) --- total: total=4.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5, (1, 1): 0.25, (1, 2): 0.25}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.5, (1, 1): 0.25, (1, 2): 0.25}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 1.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=3.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in decode_message(signal=2) Receiver 5 got option: (2, 1) and decoded action: 1
Receiver 5 received signals: [2] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 2): 1.0 -> 2.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 1): 1.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 2.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=4.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.25, (0, 1): 0.5, (0, 2): 0.25}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.25, (0, 1): 0.5, (0, 2): 0.25}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 2.0, (1, 1): 1.0, (1, 2): 1.0}
in get_filtered_urn(filter=1) --- total: total=4.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5, (1, 1): 0.25, (1, 2): 0.25}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.5, (1, 1): 0.25, (1, 2): 0.25}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 2.0 -> 3.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 2.0 -> 3.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=3.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=4.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
in decode_message(signal=2) Receiver 5 got option: (2, 1) and decoded action: 1
Receiver 5 received signals: [2] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 2): 1.0 -> 1.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 1): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 1.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=3.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 3.0, (1, 1): 1.0, (1, 2): 1.0}
in get_filtered_urn(filter=1) --- total: total=5.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6, (1, 1): 0.2, (1, 2): 0.2}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.6, (1, 1): 0.2, (1, 2): 0.2}
in decode_message(signal=1) Receiver 2 got option: (1, 1) and decoded action: 1
Receiver 2 received signals: [1] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 1): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 1): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=3.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 1.0}
in get_filtered_urn(filter=1) --- total: total=3.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3333333333333333, (1, 1): 0.3333333333333333, (1, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.3333333333333333, (1, 1): 0.3333333333333333, (1, 2): 0.3333333333333333}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 1.0 -> 1.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 1.0 -> 1.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 1.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=3.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=3.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in decode_message(signal=0) Receiver 2 got option: (0, 0) and decoded action: 0
Receiver 2 received signals: [0] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 0): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 0): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 1.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=3.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 2.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=4.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.25, (0, 1): 0.5, (0, 2): 0.25}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.25, (0, 1): 0.5, (0, 2): 0.25}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 0): 1.0 -> 2.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 2): 1.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 1.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=3.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=3.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in decode_message(signal=0) Receiver 2 got option: (0, 0) and decoded action: 0
Receiver 2 received signals: [0] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 0): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 0): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 2.0, (2, 1): 1.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=4.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5, (2, 1): 0.25, (2, 2): 0.25}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.5, (2, 1): 0.25, (2, 2): 0.25}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=4.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 2): 1.0 -> 1.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 1.0 -> 1.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 1.0}
in get_filtered_urn(filter=1) --- total: total=3.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3333333333333333, (1, 1): 0.3333333333333333, (1, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.3333333333333333, (1, 1): 0.3333333333333333, (1, 2): 0.3333333333333333}
Sender 1 got filter 1 choose option: (1, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 3.0, (1, 1): 1.0, (1, 2): 1.0}
in get_filtered_urn(filter=1) --- total: total=5.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6, (1, 1): 0.2, (1, 2): 0.2}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.6, (1, 1): 0.2, (1, 2): 0.2}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (1, 1): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 0): 3.0 -> 3.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 2.0, (2, 1): 1.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=4.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5, (2, 1): 0.25, (2, 2): 0.25}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.5, (2, 1): 0.25, (2, 2): 0.25}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 1.0}
in get_filtered_urn(filter=1) --- total: total=3.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3333333333333333, (1, 1): 0.3333333333333333, (1, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.3333333333333333, (1, 1): 0.3333333333333333, (1, 2): 0.3333333333333333}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 1.0 -> 2.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 1.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 1.0}
in get_filtered_urn(filter=1) --- total: total=3.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3333333333333333, (1, 1): 0.3333333333333333, (1, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.3333333333333333, (1, 1): 0.3333333333333333, (1, 2): 0.3333333333333333}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 1.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=3.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 1.0 -> 2.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 1.0 -> 2.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 2.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=5.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.4, (2, 1): 0.4, (2, 2): 0.2}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.4, (2, 1): 0.4, (2, 2): 0.2}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 2.0, (0, 2): 2.0}
in get_filtered_urn(filter=0) --- total: total=5.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2, (0, 1): 0.4, (0, 2): 0.4}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.2, (0, 1): 0.4, (0, 2): 0.4}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 0): 2.0 -> 3.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 2): 2.0 -> 3.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 3.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=5.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2, (0, 1): 0.6, (0, 2): 0.2}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.2, (0, 1): 0.6, (0, 2): 0.2}
Sender 1 got filter 0 choose option: (0, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=4.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 2): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 1): 2.0 -> 2.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=3.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
Sender 4 got filter 0 choose option: (0, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 2.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=6.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.16666666666666666, (0, 1): 0.3333333333333333, (0, 2): 0.5}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.16666666666666666, (0, 1): 0.3333333333333333, (0, 2): 0.5}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 0): 1.0 -> 1.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 3.0 -> 3.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=4.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.25, (1, 1): 0.25, (1, 2): 0.5}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.25, (1, 1): 0.25, (1, 2): 0.5}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=4.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 2.0 -> 3.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 2.0 -> 3.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 2.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=5.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.4, (1, 1): 0.2, (1, 2): 0.4}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.4, (1, 1): 0.2, (1, 2): 0.4}
Sender 4 got filter 1 choose option: (1, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=4.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.25, (1, 1): 0.25, (1, 2): 0.5}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.25, (1, 1): 0.25, (1, 2): 0.5}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 1): 1.0 -> 1.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 1.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=3.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
Sender 1 got filter 2 choose option: (2, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 3.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=5.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.2, (2, 1): 0.6, (2, 2): 0.2}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.2, (2, 1): 0.6, (2, 2): 0.2}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 2): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 1): 3.0 -> 3.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=3.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=4.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
in decode_message(signal=2) Receiver 5 got option: (2, 1) and decoded action: 1
Receiver 5 received signals: [2] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 2): 1.0 -> 1.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 1): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=5.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.2, (1, 1): 0.2, (1, 2): 0.6}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.2, (1, 1): 0.2, (1, 2): 0.6}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 3.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=5.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.2, (2, 1): 0.6, (2, 2): 0.2}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.2, (2, 1): 0.6, (2, 2): 0.2}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 3.0 -> 4.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 3.0 -> 4.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=6.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=4.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
in decode_message(signal=2) Receiver 5 got option: (2, 1) and decoded action: 1
Receiver 5 received signals: [2] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 2): 1.0 -> 1.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 1): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=6.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.16666666666666666, (1, 1): 0.16666666666666666, (1, 2): 0.6666666666666666}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.16666666666666666, (1, 1): 0.16666666666666666, (1, 2): 0.6666666666666666}
Sender 1 got filter 1 choose option: (1, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 3.0, (1, 1): 1.0, (1, 2): 1.0}
in get_filtered_urn(filter=1) --- total: total=5.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6, (1, 1): 0.2, (1, 2): 0.2}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.6, (1, 1): 0.2, (1, 2): 0.2}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (1, 1): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 0): 3.0 -> 3.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 2.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=5.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.4, (1, 1): 0.2, (1, 2): 0.4}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.4, (1, 1): 0.2, (1, 2): 0.4}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 2.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=6.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.16666666666666666, (0, 1): 0.3333333333333333, (0, 2): 0.5}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.16666666666666666, (0, 1): 0.3333333333333333, (0, 2): 0.5}
in decode_message(signal=0) Receiver 5 got option: (0, 0) and decoded action: 0
Receiver 5 received signals: [0] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 0): 1.0 -> 1.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=6.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.16666666666666666, (1, 1): 0.16666666666666666, (1, 2): 0.6666666666666666}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.16666666666666666, (1, 1): 0.16666666666666666, (1, 2): 0.6666666666666666}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=6.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.16666666666666666, (2, 1): 0.6666666666666666, (2, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.16666666666666666, (2, 1): 0.6666666666666666, (2, 2): 0.16666666666666666}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 4.0 -> 5.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 4.0 -> 5.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=6.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=4.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.25, (1, 1): 0.25, (1, 2): 0.5}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.25, (1, 1): 0.25, (1, 2): 0.5}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 1.0 -> 1.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 5.0}
in get_filtered_urn(filter=1) --- total: total=7.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.14285714285714285, (1, 1): 0.14285714285714285, (1, 2): 0.7142857142857143}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.14285714285714285, (1, 1): 0.14285714285714285, (1, 2): 0.7142857142857143}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 5.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=7.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.14285714285714285, (2, 1): 0.7142857142857143, (2, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.14285714285714285, (2, 1): 0.7142857142857143, (2, 2): 0.14285714285714285}
in decode_message(signal=2) Receiver 2 got option: (2, 0) and decoded action: 0
Receiver 2 received signals: [2] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (1, 2): 5.0 -> 5.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 0): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=3.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=4.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.25, (1, 1): 0.25, (1, 2): 0.5}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.25, (1, 1): 0.25, (1, 2): 0.5}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 1): 1.0 -> 2.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 0): 1.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 5.0}
in get_filtered_urn(filter=1) --- total: total=7.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.14285714285714285, (1, 1): 0.14285714285714285, (1, 2): 0.7142857142857143}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.14285714285714285, (1, 1): 0.14285714285714285, (1, 2): 0.7142857142857143}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 5.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=7.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.14285714285714285, (2, 1): 0.7142857142857143, (2, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.14285714285714285, (2, 1): 0.7142857142857143, (2, 2): 0.14285714285714285}
in decode_message(signal=2) Receiver 2 got option: (2, 0) and decoded action: 0
Receiver 2 received signals: [2] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (1, 2): 5.0 -> 5.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 0): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 2.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=5.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.4, (1, 1): 0.2, (1, 2): 0.4}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.4, (1, 1): 0.2, (1, 2): 0.4}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=4.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 1.0 -> 1.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 1.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=3.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=3.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in decode_message(signal=0) Receiver 2 got option: (0, 1) and decoded action: 1
Receiver 2 received signals: [0] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 0): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 1): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 2.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=5.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.4, (1, 1): 0.2, (1, 2): 0.4}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.4, (1, 1): 0.2, (1, 2): 0.4}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 2.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=6.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.16666666666666666, (0, 1): 0.3333333333333333, (0, 2): 0.5}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.16666666666666666, (0, 1): 0.3333333333333333, (0, 2): 0.5}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 3.0 -> 3.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 1.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=3.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
Sender 1 got filter 2 choose option: (2, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 5.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=7.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.14285714285714285, (2, 1): 0.7142857142857143, (2, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.14285714285714285, (2, 1): 0.7142857142857143, (2, 2): 0.14285714285714285}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 2): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 1): 5.0 -> 5.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 2.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=4.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.25, (0, 1): 0.5, (0, 2): 0.25}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.25, (0, 1): 0.5, (0, 2): 0.25}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=4.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 1.0 -> 2.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 1.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 5.0}
in get_filtered_urn(filter=1) --- total: total=7.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.14285714285714285, (1, 1): 0.14285714285714285, (1, 2): 0.7142857142857143}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.14285714285714285, (1, 1): 0.14285714285714285, (1, 2): 0.7142857142857143}
Sender 1 got filter 1 choose option: (1, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=3.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (1, 0): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 2): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 2.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=5.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.4, (1, 1): 0.2, (1, 2): 0.4}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.4, (1, 1): 0.2, (1, 2): 0.4}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 2.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=6.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.16666666666666666, (0, 1): 0.3333333333333333, (0, 2): 0.5}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.16666666666666666, (0, 1): 0.3333333333333333, (0, 2): 0.5}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 2.0 -> 3.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 2.0 -> 3.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 1.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=3.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 3.0, (1, 1): 1.0, (1, 2): 1.0}
in get_filtered_urn(filter=1) --- total: total=5.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6, (1, 1): 0.2, (1, 2): 0.2}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.6, (1, 1): 0.2, (1, 2): 0.2}
in decode_message(signal=1) Receiver 2 got option: (1, 1) and decoded action: 1
Receiver 2 received signals: [1] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 1): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 1): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 2.0, (0, 2): 2.0}
in get_filtered_urn(filter=0) --- total: total=5.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2, (0, 1): 0.4, (0, 2): 0.4}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.2, (0, 1): 0.4, (0, 2): 0.4}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 2.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=5.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.4, (1, 1): 0.2, (1, 2): 0.4}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.4, (1, 1): 0.2, (1, 2): 0.4}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 1): 2.0 -> 3.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 0): 2.0 -> 3.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 3.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=5.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2, (0, 1): 0.6, (0, 2): 0.2}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.2, (0, 1): 0.6, (0, 2): 0.2}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 3.0, (1, 1): 1.0, (1, 2): 1.0}
in get_filtered_urn(filter=1) --- total: total=5.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6, (1, 1): 0.2, (1, 2): 0.2}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.6, (1, 1): 0.2, (1, 2): 0.2}
in decode_message(signal=1) Receiver 2 got option: (1, 1) and decoded action: 1
Receiver 2 received signals: [1] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 1): 3.0 -> 3.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 1): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 3.0, (0, 2): 2.0}
in get_filtered_urn(filter=0) --- total: total=6.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.16666666666666666, (0, 1): 0.5, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.16666666666666666, (0, 1): 0.5, (0, 2): 0.3333333333333333}
Sender 4 got filter 0 choose option: (0, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 3.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=7.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.14285714285714285, (0, 1): 0.42857142857142855, (0, 2): 0.42857142857142855}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.14285714285714285, (0, 1): 0.42857142857142855, (0, 2): 0.42857142857142855}
in decode_message(signal=0) Receiver 5 got option: (0, 0) and decoded action: 0
Receiver 5 received signals: [0] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 0): 1.0 -> 2.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 0): 1.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 1.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=3.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 3.0, (1, 1): 1.0, (1, 2): 1.0}
in get_filtered_urn(filter=1) --- total: total=5.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6, (1, 1): 0.2, (1, 2): 0.2}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.6, (1, 1): 0.2, (1, 2): 0.2}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 1): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 0): 3.0 -> 3.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 3.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=6.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5, (1, 1): 0.16666666666666666, (1, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.5, (1, 1): 0.16666666666666666, (1, 2): 0.3333333333333333}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 3.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=8.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.25, (0, 1): 0.375, (0, 2): 0.375}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.25, (0, 1): 0.375, (0, 2): 0.375}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 3.0 -> 4.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 3.0 -> 4.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 5.0}
in get_filtered_urn(filter=1) --- total: total=7.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.14285714285714285, (1, 1): 0.14285714285714285, (1, 2): 0.7142857142857143}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.14285714285714285, (1, 1): 0.14285714285714285, (1, 2): 0.7142857142857143}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 5.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=7.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.14285714285714285, (2, 1): 0.7142857142857143, (2, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.14285714285714285, (2, 1): 0.7142857142857143, (2, 2): 0.14285714285714285}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 5.0 -> 6.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 5.0 -> 6.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=6.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 4.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=9.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2222222222222222, (0, 1): 0.4444444444444444, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.2222222222222222, (0, 1): 0.4444444444444444, (0, 2): 0.3333333333333333}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 3.0 -> 3.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 4.0 -> 4.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 3.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=5.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2, (0, 1): 0.6, (0, 2): 0.2}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.2, (0, 1): 0.6, (0, 2): 0.2}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 3.0, (1, 1): 1.0, (1, 2): 1.0}
in get_filtered_urn(filter=1) --- total: total=5.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6, (1, 1): 0.2, (1, 2): 0.2}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.6, (1, 1): 0.2, (1, 2): 0.2}
in decode_message(signal=1) Receiver 2 got option: (1, 2) and decoded action: 2
Receiver 2 received signals: [1] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 1): 3.0 -> 3.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 2): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 3.0, (0, 2): 2.0}
in get_filtered_urn(filter=0) --- total: total=7.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2857142857142857, (0, 1): 0.42857142857142855, (0, 2): 0.2857142857142857}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.2857142857142857, (0, 1): 0.42857142857142855, (0, 2): 0.2857142857142857}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 2.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=5.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.4, (2, 1): 0.4, (2, 2): 0.2}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.4, (2, 1): 0.4, (2, 2): 0.2}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 2.0 -> 3.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 2.0 -> 3.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 3.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=5.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2, (0, 1): 0.6, (0, 2): 0.2}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.2, (0, 1): 0.6, (0, 2): 0.2}
Sender 1 got filter 0 choose option: (0, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 6.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=8.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.125, (2, 1): 0.75, (2, 2): 0.125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.125, (2, 1): 0.75, (2, 2): 0.125}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 2): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 1): 6.0 -> 6.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=7.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5714285714285714, (1, 1): 0.14285714285714285, (1, 2): 0.2857142857142857}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.5714285714285714, (1, 1): 0.14285714285714285, (1, 2): 0.2857142857142857}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 4.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=9.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2222222222222222, (0, 1): 0.4444444444444444, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.2222222222222222, (0, 1): 0.4444444444444444, (0, 2): 0.3333333333333333}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 3.0 -> 3.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 3.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=5.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2, (0, 1): 0.6, (0, 2): 0.2}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.2, (0, 1): 0.6, (0, 2): 0.2}
Sender 1 got filter 0 choose option: (0, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=3.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in decode_message(signal=0) Receiver 2 got option: (0, 1) and decoded action: 1
Receiver 2 received signals: [0] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 0): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 1): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=6.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=6.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
in decode_message(signal=2) Receiver 5 got option: (2, 1) and decoded action: 1
Receiver 5 received signals: [2] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 2): 1.0 -> 1.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 1): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 1.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=3.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 3.0, (1, 1): 1.0, (1, 2): 1.0}
in get_filtered_urn(filter=1) --- total: total=5.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6, (1, 1): 0.2, (1, 2): 0.2}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.6, (1, 1): 0.2, (1, 2): 0.2}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 1): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 0): 3.0 -> 3.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=6.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 4.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=9.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2222222222222222, (0, 1): 0.4444444444444444, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.2222222222222222, (0, 1): 0.4444444444444444, (0, 2): 0.3333333333333333}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 3.0 -> 3.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 4.0 -> 4.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 1.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=3.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
Sender 1 got filter 2 choose option: (2, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 6.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=8.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.125, (2, 1): 0.75, (2, 2): 0.125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.125, (2, 1): 0.75, (2, 2): 0.125}
in decode_message(signal=2) Receiver 2 got option: (2, 0) and decoded action: 0
Receiver 2 received signals: [2] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 2): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 0): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=7.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5714285714285714, (1, 1): 0.14285714285714285, (1, 2): 0.2857142857142857}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.5714285714285714, (1, 1): 0.14285714285714285, (1, 2): 0.2857142857142857}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=6.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
in decode_message(signal=2) Receiver 5 got option: (2, 1) and decoded action: 1
Receiver 5 received signals: [2] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 2): 2.0 -> 3.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 1): 2.0 -> 3.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 1.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=3.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
Sender 1 got filter 2 choose option: (2, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 6.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=8.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.125, (2, 1): 0.75, (2, 2): 0.125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.125, (2, 1): 0.75, (2, 2): 0.125}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 2): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 1): 6.0 -> 6.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=6.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 4.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=9.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2222222222222222, (0, 1): 0.4444444444444444, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.2222222222222222, (0, 1): 0.4444444444444444, (0, 2): 0.3333333333333333}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 3.0 -> 3.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 4.0 -> 4.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 6.0}
in get_filtered_urn(filter=1) --- total: total=8.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.125, (1, 1): 0.125, (1, 2): 0.75}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.125, (1, 1): 0.125, (1, 2): 0.75}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 6.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=8.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.125, (2, 1): 0.75, (2, 2): 0.125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.125, (2, 1): 0.75, (2, 2): 0.125}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 6.0 -> 7.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 6.0 -> 7.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 1.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=8.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 3.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=7.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.42857142857142855, (2, 1): 0.42857142857142855, (2, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.42857142857142855, (2, 1): 0.42857142857142855, (2, 2): 0.14285714285714285}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 3.0 -> 3.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 3.0 -> 3.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 1.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=3.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.3333333333333333, (2, 2): 0.3333333333333333}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 3.0, (1, 1): 1.0, (1, 2): 1.0}
in get_filtered_urn(filter=1) --- total: total=5.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6, (1, 1): 0.2, (1, 2): 0.2}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.6, (1, 1): 0.2, (1, 2): 0.2}
in decode_message(signal=1) Receiver 2 got option: (1, 2) and decoded action: 2
Receiver 2 received signals: [1] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 1): 1.0 -> 2.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 2): 1.0 -> 2.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 3.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=8.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.25, (0, 1): 0.375, (0, 2): 0.375}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.25, (0, 1): 0.375, (0, 2): 0.375}
Sender 4 got filter 0 choose option: (0, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 4.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=9.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2222222222222222, (0, 1): 0.4444444444444444, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.2222222222222222, (0, 1): 0.4444444444444444, (0, 2): 0.3333333333333333}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 0): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 4.0 -> 4.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=4.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 3.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=6.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5, (1, 1): 0.16666666666666666, (1, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.5, (1, 1): 0.16666666666666666, (1, 2): 0.3333333333333333}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 1): 2.0 -> 2.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 0): 3.0 -> 3.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 3.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=8.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.25, (0, 1): 0.375, (0, 2): 0.375}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.25, (0, 1): 0.375, (0, 2): 0.375}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 3.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=7.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.42857142857142855, (2, 1): 0.42857142857142855, (2, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.42857142857142855, (2, 1): 0.42857142857142855, (2, 2): 0.14285714285714285}
in decode_message(signal=2) Receiver 5 got option: (2, 2) and decoded action: 2
Receiver 5 received signals: [2] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 2): 3.0 -> 3.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 2): 1.0 -> 1.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 7.0}
in get_filtered_urn(filter=1) --- total: total=9.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.1111111111111111, (1, 1): 0.1111111111111111, (1, 2): 0.7777777777777778}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.1111111111111111, (1, 1): 0.1111111111111111, (1, 2): 0.7777777777777778}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 7.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=9.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.1111111111111111, (2, 1): 0.7777777777777778, (2, 2): 0.1111111111111111}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.1111111111111111, (2, 1): 0.7777777777777778, (2, 2): 0.1111111111111111}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 7.0 -> 8.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 7.0 -> 8.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 3.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=8.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.25, (0, 1): 0.375, (0, 2): 0.375}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.25, (0, 1): 0.375, (0, 2): 0.375}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 3.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=6.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5, (1, 1): 0.16666666666666666, (1, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.5, (1, 1): 0.16666666666666666, (1, 2): 0.3333333333333333}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 3.0 -> 3.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 3.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=5.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2, (0, 1): 0.6, (0, 2): 0.2}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.2, (0, 1): 0.6, (0, 2): 0.2}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 3.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=6.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5, (1, 1): 0.16666666666666666, (1, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.5, (1, 1): 0.16666666666666666, (1, 2): 0.3333333333333333}
in decode_message(signal=1) Receiver 2 got option: (1, 2) and decoded action: 2
Receiver 2 received signals: [1] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 1): 3.0 -> 3.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 2): 2.0 -> 2.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 3.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=8.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.25, (0, 1): 0.375, (0, 2): 0.375}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.25, (0, 1): 0.375, (0, 2): 0.375}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 3.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=6.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5, (1, 1): 0.16666666666666666, (1, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.5, (1, 1): 0.16666666666666666, (1, 2): 0.3333333333333333}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 3.0 -> 3.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 3.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=5.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2, (0, 1): 0.6, (0, 2): 0.2}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.2, (0, 1): 0.6, (0, 2): 0.2}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 3.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=6.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5, (1, 1): 0.16666666666666666, (1, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.5, (1, 1): 0.16666666666666666, (1, 2): 0.3333333333333333}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 3.0 -> 4.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 3.0 -> 4.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=6.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 4.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=9.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2222222222222222, (0, 1): 0.4444444444444444, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.2222222222222222, (0, 1): 0.4444444444444444, (0, 2): 0.3333333333333333}
in decode_message(signal=0) Receiver 5 got option: (0, 0) and decoded action: 0
Receiver 5 received signals: [0] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 3.0 -> 3.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 0): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=4.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=3.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in decode_message(signal=0) Receiver 2 got option: (0, 0) and decoded action: 0
Receiver 2 received signals: [0] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 0): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 0): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=6.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 3.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=7.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.42857142857142855, (2, 1): 0.42857142857142855, (2, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.42857142857142855, (2, 1): 0.42857142857142855, (2, 2): 0.14285714285714285}
in decode_message(signal=2) Receiver 5 got option: (2, 1) and decoded action: 1
Receiver 5 received signals: [2] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 2): 1.0 -> 1.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 1): 3.0 -> 3.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 4.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=6.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.16666666666666666, (0, 1): 0.6666666666666666, (0, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.16666666666666666, (0, 1): 0.6666666666666666, (0, 2): 0.16666666666666666}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=7.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5714285714285714, (1, 1): 0.14285714285714285, (1, 2): 0.2857142857142857}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.5714285714285714, (1, 1): 0.14285714285714285, (1, 2): 0.2857142857142857}
in decode_message(signal=1) Receiver 2 got option: (1, 1) and decoded action: 1
Receiver 2 received signals: [1] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 1): 4.0 -> 4.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 1): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=6.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 3.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=6.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5, (1, 1): 0.16666666666666666, (1, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.5, (1, 1): 0.16666666666666666, (1, 2): 0.3333333333333333}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 2.0 -> 3.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 2.0 -> 3.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 4.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=6.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.16666666666666666, (0, 1): 0.6666666666666666, (0, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.16666666666666666, (0, 1): 0.6666666666666666, (0, 2): 0.16666666666666666}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=7.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5714285714285714, (1, 1): 0.14285714285714285, (1, 2): 0.2857142857142857}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.5714285714285714, (1, 1): 0.14285714285714285, (1, 2): 0.2857142857142857}
in decode_message(signal=1) Receiver 2 got option: (1, 1) and decoded action: 1
Receiver 2 received signals: [1] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 1): 4.0 -> 4.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 1): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 1.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=8.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 3.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=7.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.42857142857142855, (2, 1): 0.42857142857142855, (2, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.42857142857142855, (2, 1): 0.42857142857142855, (2, 2): 0.14285714285714285}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 3.0 -> 3.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 3.0 -> 3.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 8.0}
in get_filtered_urn(filter=1) --- total: total=10.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.1, (1, 1): 0.1, (1, 2): 0.8}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.1, (1, 1): 0.1, (1, 2): 0.8}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 8.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=10.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.1, (2, 1): 0.8, (2, 2): 0.1}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.1, (2, 1): 0.8, (2, 2): 0.1}
in decode_message(signal=2) Receiver 2 got option: (2, 2) and decoded action: 2
Receiver 2 received signals: [2] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (1, 2): 8.0 -> 8.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 2): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 1.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=8.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 3.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=7.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.42857142857142855, (2, 1): 0.42857142857142855, (2, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.42857142857142855, (2, 1): 0.42857142857142855, (2, 2): 0.14285714285714285}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 3.0 -> 3.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 3.0 -> 3.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 8.0}
in get_filtered_urn(filter=1) --- total: total=10.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.1, (1, 1): 0.1, (1, 2): 0.8}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.1, (1, 1): 0.1, (1, 2): 0.8}
Sender 1 got filter 1 choose option: (1, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=3.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (1, 0): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 2): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 1.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=8.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 4.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=9.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2222222222222222, (0, 1): 0.4444444444444444, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.2222222222222222, (0, 1): 0.4444444444444444, (0, 2): 0.3333333333333333}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 3.0 -> 3.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=4.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=7.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5714285714285714, (1, 1): 0.14285714285714285, (1, 2): 0.2857142857142857}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.5714285714285714, (1, 1): 0.14285714285714285, (1, 2): 0.2857142857142857}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 1): 2.0 -> 2.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 0): 4.0 -> 4.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 3.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=8.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.25, (0, 1): 0.375, (0, 2): 0.375}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.25, (0, 1): 0.375, (0, 2): 0.375}
Sender 4 got filter 0 choose option: (0, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 4.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=9.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2222222222222222, (0, 1): 0.4444444444444444, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.2222222222222222, (0, 1): 0.4444444444444444, (0, 2): 0.3333333333333333}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 0): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 4.0 -> 4.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=4.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=7.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5714285714285714, (1, 1): 0.14285714285714285, (1, 2): 0.2857142857142857}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.5714285714285714, (1, 1): 0.14285714285714285, (1, 2): 0.2857142857142857}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 1): 2.0 -> 2.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 0): 4.0 -> 4.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 3.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=7.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.42857142857142855, (2, 1): 0.42857142857142855, (2, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.42857142857142855, (2, 1): 0.42857142857142855, (2, 2): 0.14285714285714285}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 3.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=7.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.42857142857142855, (2, 1): 0.42857142857142855, (2, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.42857142857142855, (2, 1): 0.42857142857142855, (2, 2): 0.14285714285714285}
in decode_message(signal=2) Receiver 5 got option: (2, 2) and decoded action: 2
Receiver 5 received signals: [2] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 2): 1.0 -> 2.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 2): 1.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 4.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=6.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.16666666666666666, (0, 1): 0.6666666666666666, (0, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.16666666666666666, (0, 1): 0.6666666666666666, (0, 2): 0.16666666666666666}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=7.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5714285714285714, (1, 1): 0.14285714285714285, (1, 2): 0.2857142857142857}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.5714285714285714, (1, 1): 0.14285714285714285, (1, 2): 0.2857142857142857}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 4.0 -> 5.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 4.0 -> 5.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 3.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=8.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.25, (0, 1): 0.375, (0, 2): 0.375}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.25, (0, 1): 0.375, (0, 2): 0.375}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=8.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.375, (2, 1): 0.375, (2, 2): 0.25}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.375, (2, 1): 0.375, (2, 2): 0.25}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 3.0 -> 4.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 3.0 -> 4.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 8.0}
in get_filtered_urn(filter=1) --- total: total=10.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.1, (1, 1): 0.1, (1, 2): 0.8}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.1, (1, 1): 0.1, (1, 2): 0.8}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 8.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=10.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.1, (2, 1): 0.8, (2, 2): 0.1}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.1, (2, 1): 0.8, (2, 2): 0.1}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 8.0 -> 9.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 8.0 -> 9.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 3.0, (0, 2): 4.0}
in get_filtered_urn(filter=0) --- total: total=9.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2222222222222222, (0, 1): 0.3333333333333333, (0, 2): 0.4444444444444444}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.2222222222222222, (0, 1): 0.3333333333333333, (0, 2): 0.4444444444444444}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 4.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=9.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.4444444444444444, (2, 1): 0.3333333333333333, (2, 2): 0.2222222222222222}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.4444444444444444, (2, 1): 0.3333333333333333, (2, 2): 0.2222222222222222}
in decode_message(signal=2) Receiver 5 got option: (2, 1) and decoded action: 1
Receiver 5 received signals: [2] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 2): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 1): 3.0 -> 3.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 5.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=7.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.14285714285714285, (0, 1): 0.7142857142857143, (0, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.14285714285714285, (0, 1): 0.7142857142857143, (0, 2): 0.14285714285714285}
Sender 1 got filter 0 choose option: (0, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 9.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=11.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09090909090909091, (2, 1): 0.8181818181818182, (2, 2): 0.09090909090909091}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.09090909090909091, (2, 1): 0.8181818181818182, (2, 2): 0.09090909090909091}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 2): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 1): 9.0 -> 9.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 3.0, (0, 2): 4.0}
in get_filtered_urn(filter=0) --- total: total=9.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2222222222222222, (0, 1): 0.3333333333333333, (0, 2): 0.4444444444444444}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.2222222222222222, (0, 1): 0.3333333333333333, (0, 2): 0.4444444444444444}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 3.0, (1, 1): 1.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=7.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.42857142857142855, (1, 1): 0.14285714285714285, (1, 2): 0.42857142857142855}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.42857142857142855, (1, 1): 0.14285714285714285, (1, 2): 0.42857142857142855}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 3.0 -> 3.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 3.0 -> 3.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 5.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=7.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.14285714285714285, (0, 1): 0.7142857142857143, (0, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.14285714285714285, (0, 1): 0.7142857142857143, (0, 2): 0.14285714285714285}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 5.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=8.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.625, (1, 1): 0.125, (1, 2): 0.25}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.625, (1, 1): 0.125, (1, 2): 0.25}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 5.0 -> 6.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 5.0 -> 6.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 1.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=8.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
Sender 4 got filter 1 choose option: (1, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 3.0, (1, 1): 1.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=7.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.42857142857142855, (1, 1): 0.14285714285714285, (1, 2): 0.42857142857142855}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.42857142857142855, (1, 1): 0.14285714285714285, (1, 2): 0.42857142857142855}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 1): 1.0 -> 1.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 3.0 -> 3.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 6.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=8.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.125, (0, 1): 0.75, (0, 2): 0.125}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.125, (0, 1): 0.75, (0, 2): 0.125}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 6.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=9.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6666666666666666, (1, 1): 0.1111111111111111, (1, 2): 0.2222222222222222}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.6666666666666666, (1, 1): 0.1111111111111111, (1, 2): 0.2222222222222222}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 6.0 -> 7.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 6.0 -> 7.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 3.0, (0, 2): 4.0}
in get_filtered_urn(filter=0) --- total: total=9.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2222222222222222, (0, 1): 0.3333333333333333, (0, 2): 0.4444444444444444}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.2222222222222222, (0, 1): 0.3333333333333333, (0, 2): 0.4444444444444444}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 3.0, (1, 1): 1.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=7.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.42857142857142855, (1, 1): 0.14285714285714285, (1, 2): 0.42857142857142855}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.42857142857142855, (1, 1): 0.14285714285714285, (1, 2): 0.42857142857142855}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 1): 3.0 -> 4.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 0): 3.0 -> 4.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 9.0}
in get_filtered_urn(filter=1) --- total: total=11.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.09090909090909091, (1, 1): 0.09090909090909091, (1, 2): 0.8181818181818182}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.09090909090909091, (1, 1): 0.09090909090909091, (1, 2): 0.8181818181818182}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 9.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=11.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09090909090909091, (2, 1): 0.8181818181818182, (2, 2): 0.09090909090909091}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.09090909090909091, (2, 1): 0.8181818181818182, (2, 2): 0.09090909090909091}
in decode_message(signal=2) Receiver 2 got option: (2, 0) and decoded action: 0
Receiver 2 received signals: [2] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (1, 2): 9.0 -> 9.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 0): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 1.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=8.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
Sender 4 got filter 1 choose option: (1, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 1.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=8.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 1): 1.0 -> 1.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 3.0 -> 3.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 9.0}
in get_filtered_urn(filter=1) --- total: total=11.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.09090909090909091, (1, 1): 0.09090909090909091, (1, 2): 0.8181818181818182}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.09090909090909091, (1, 1): 0.09090909090909091, (1, 2): 0.8181818181818182}
Sender 1 got filter 1 choose option: (1, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=3.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (1, 0): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 2): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 4.0, (0, 2): 4.0}
in get_filtered_urn(filter=0) --- total: total=10.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2, (0, 1): 0.4, (0, 2): 0.4}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.2, (0, 1): 0.4, (0, 2): 0.4}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 4.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=9.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.4444444444444444, (2, 1): 0.3333333333333333, (2, 2): 0.2222222222222222}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.4444444444444444, (2, 1): 0.3333333333333333, (2, 2): 0.2222222222222222}
in decode_message(signal=2) Receiver 5 got option: (2, 2) and decoded action: 2
Receiver 5 received signals: [2] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 2): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 7.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=9.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.1111111111111111, (0, 1): 0.7777777777777778, (0, 2): 0.1111111111111111}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.1111111111111111, (0, 1): 0.7777777777777778, (0, 2): 0.1111111111111111}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 7.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=10.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7, (1, 1): 0.1, (1, 2): 0.2}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7, (1, 1): 0.1, (1, 2): 0.2}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 7.0 -> 8.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 7.0 -> 8.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 1.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=8.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
Sender 4 got filter 1 choose option: (1, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 1.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=8.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 1): 1.0 -> 1.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 4.0 -> 4.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 8.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=10.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.1, (0, 1): 0.8, (0, 2): 0.1}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.1, (0, 1): 0.8, (0, 2): 0.1}
Sender 1 got filter 0 choose option: (0, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=3.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 0): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 2): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 1.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=8.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 4.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=9.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2222222222222222, (0, 1): 0.4444444444444444, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.2222222222222222, (0, 1): 0.4444444444444444, (0, 2): 0.3333333333333333}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 4.0 -> 5.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 4.0 -> 5.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=4.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.25, (2, 1): 0.5, (2, 2): 0.25}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=3.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.3333333333333333, (0, 1): 0.3333333333333333, (0, 2): 0.3333333333333333}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 1.0 -> 2.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 1.0 -> 2.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=8.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.375, (2, 1): 0.375, (2, 2): 0.25}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.375, (2, 1): 0.375, (2, 2): 0.25}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 4.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=9.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.4444444444444444, (2, 1): 0.3333333333333333, (2, 2): 0.2222222222222222}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.4444444444444444, (2, 1): 0.3333333333333333, (2, 2): 0.2222222222222222}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 4.0 -> 4.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 2.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=5.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.4, (2, 1): 0.4, (2, 2): 0.2}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.4, (2, 1): 0.4, (2, 2): 0.2}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 2.0}
in get_filtered_urn(filter=0) --- total: total=4.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.25, (0, 1): 0.25, (0, 2): 0.5}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.25, (0, 1): 0.25, (0, 2): 0.5}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 2.0 -> 3.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 2.0 -> 3.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=8.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.375, (2, 1): 0.375, (2, 2): 0.25}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.375, (2, 1): 0.375, (2, 2): 0.25}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 1.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=8.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 3.0 -> 3.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 4.0 -> 4.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 9.0}
in get_filtered_urn(filter=1) --- total: total=11.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.09090909090909091, (1, 1): 0.09090909090909091, (1, 2): 0.8181818181818182}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.09090909090909091, (1, 1): 0.09090909090909091, (1, 2): 0.8181818181818182}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 9.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=11.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09090909090909091, (2, 1): 0.8181818181818182, (2, 2): 0.09090909090909091}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.09090909090909091, (2, 1): 0.8181818181818182, (2, 2): 0.09090909090909091}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 9.0 -> 10.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 9.0 -> 10.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=8.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.375, (2, 1): 0.375, (2, 2): 0.25}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.375, (2, 1): 0.375, (2, 2): 0.25}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 1.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=8.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.5, (1, 1): 0.125, (1, 2): 0.375}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 3.0 -> 4.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 3.0 -> 4.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 8.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=10.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.1, (0, 1): 0.8, (0, 2): 0.1}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.1, (0, 1): 0.8, (0, 2): 0.1}
Sender 1 got filter 0 choose option: (0, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 10.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=12.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.08333333333333333, (2, 1): 0.8333333333333334, (2, 2): 0.08333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.08333333333333333, (2, 1): 0.8333333333333334, (2, 2): 0.08333333333333333}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 2): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 1): 10.0 -> 10.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=9.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.4444444444444444, (2, 2): 0.2222222222222222}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.4444444444444444, (2, 2): 0.2222222222222222}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 5.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=10.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2, (0, 1): 0.5, (0, 2): 0.3}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.2, (0, 1): 0.5, (0, 2): 0.3}
in decode_message(signal=0) Receiver 5 got option: (0, 0) and decoded action: 0
Receiver 5 received signals: [0] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 3.0 -> 3.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 0): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 10.0}
in get_filtered_urn(filter=1) --- total: total=12.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.08333333333333333, (1, 1): 0.08333333333333333, (1, 2): 0.8333333333333334}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.08333333333333333, (1, 1): 0.08333333333333333, (1, 2): 0.8333333333333334}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 10.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=12.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.08333333333333333, (2, 1): 0.8333333333333334, (2, 2): 0.08333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.08333333333333333, (2, 1): 0.8333333333333334, (2, 2): 0.08333333333333333}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 10.0 -> 11.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 10.0 -> 11.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=9.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.4444444444444444, (2, 2): 0.2222222222222222}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.4444444444444444, (2, 2): 0.2222222222222222}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=9.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.4444444444444444, (1, 1): 0.1111111111111111, (1, 2): 0.4444444444444444}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.4444444444444444, (1, 1): 0.1111111111111111, (1, 2): 0.4444444444444444}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 4.0 -> 4.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 11.0}
in get_filtered_urn(filter=1) --- total: total=13.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.07692307692307693, (1, 1): 0.07692307692307693, (1, 2): 0.8461538461538461}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.07692307692307693, (1, 1): 0.07692307692307693, (1, 2): 0.8461538461538461}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 11.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=13.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.07692307692307693, (2, 1): 0.8461538461538461, (2, 2): 0.07692307692307693}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.07692307692307693, (2, 1): 0.8461538461538461, (2, 2): 0.07692307692307693}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 11.0 -> 12.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 11.0 -> 12.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 4.0, (0, 2): 4.0}
in get_filtered_urn(filter=0) --- total: total=10.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2, (0, 1): 0.4, (0, 2): 0.4}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.2, (0, 1): 0.4, (0, 2): 0.4}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 4.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=9.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.4444444444444444, (2, 1): 0.3333333333333333, (2, 2): 0.2222222222222222}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.4444444444444444, (2, 1): 0.3333333333333333, (2, 2): 0.2222222222222222}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 4.0 -> 5.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 4.0 -> 5.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=6.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 8.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=11.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7272727272727273, (1, 1): 0.09090909090909091, (1, 2): 0.18181818181818182}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7272727272727273, (1, 1): 0.09090909090909091, (1, 2): 0.18181818181818182}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 1): 2.0 -> 2.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 0): 8.0 -> 8.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 5.0, (1, 1): 1.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=9.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5555555555555556, (1, 1): 0.1111111111111111, (1, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.5555555555555556, (1, 1): 0.1111111111111111, (1, 2): 0.3333333333333333}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 5.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=10.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2, (0, 1): 0.5, (0, 2): 0.3}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.2, (0, 1): 0.5, (0, 2): 0.3}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 5.0 -> 6.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 5.0 -> 6.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 8.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=10.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.1, (0, 1): 0.8, (0, 2): 0.1}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.1, (0, 1): 0.8, (0, 2): 0.1}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 8.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=11.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7272727272727273, (1, 1): 0.09090909090909091, (1, 2): 0.18181818181818182}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.7272727272727273, (1, 1): 0.09090909090909091, (1, 2): 0.18181818181818182}
in decode_message(signal=1) Receiver 2 got option: (1, 2) and decoded action: 2
Receiver 2 received signals: [1] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 1): 8.0 -> 8.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 2): 2.0 -> 2.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=9.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.4444444444444444, (2, 2): 0.2222222222222222}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.4444444444444444, (2, 2): 0.2222222222222222}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=9.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.4444444444444444, (1, 1): 0.1111111111111111, (1, 2): 0.4444444444444444}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.4444444444444444, (1, 1): 0.1111111111111111, (1, 2): 0.4444444444444444}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 4.0 -> 5.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 4.0 -> 5.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 2.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=6.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.5, (2, 1): 0.3333333333333333, (2, 2): 0.16666666666666666}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 8.0, (1, 1): 1.0, (1, 2): 2.0}
in get_filtered_urn(filter=1) --- total: total=11.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7272727272727273, (1, 1): 0.09090909090909091, (1, 2): 0.18181818181818182}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.7272727272727273, (1, 1): 0.09090909090909091, (1, 2): 0.18181818181818182}
in decode_message(signal=1) Receiver 2 got option: (1, 2) and decoded action: 2
Receiver 2 received signals: [1] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 1): 2.0 -> 3.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 2): 2.0 -> 3.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 6.0, (1, 1): 1.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=10.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6, (1, 1): 0.1, (1, 2): 0.3}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.6, (1, 1): 0.1, (1, 2): 0.3}
Sender 4 got filter 1 choose option: (1, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 1.0, (1, 2): 5.0}
in get_filtered_urn(filter=1) --- total: total=10.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.4, (1, 1): 0.1, (1, 2): 0.5}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.4, (1, 1): 0.1, (1, 2): 0.5}
in decode_message(signal=1) Receiver 5 got option: (1, 1) and decoded action: 1
Receiver 5 received signals: [1] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 1): 1.0 -> 2.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 1): 1.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 12.0}
in get_filtered_urn(filter=1) --- total: total=14.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.07142857142857142, (1, 1): 0.07142857142857142, (1, 2): 0.8571428571428571}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.07142857142857142, (1, 1): 0.07142857142857142, (1, 2): 0.8571428571428571}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 12.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=14.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.07142857142857142, (2, 1): 0.8571428571428571, (2, 2): 0.07142857142857142}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.07142857142857142, (2, 1): 0.8571428571428571, (2, 2): 0.07142857142857142}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 12.0 -> 13.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 12.0 -> 13.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 5.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=10.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3, (2, 1): 0.5, (2, 2): 0.2}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.3, (2, 1): 0.5, (2, 2): 0.2}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 6.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=11.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.18181818181818182, (0, 1): 0.5454545454545454, (0, 2): 0.2727272727272727}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.18181818181818182, (0, 1): 0.5454545454545454, (0, 2): 0.2727272727272727}
in decode_message(signal=0) Receiver 5 got option: (0, 0) and decoded action: 0
Receiver 5 received signals: [0] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 3.0 -> 3.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 0): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 3.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=7.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.42857142857142855, (2, 1): 0.42857142857142855, (2, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.42857142857142855, (2, 1): 0.42857142857142855, (2, 2): 0.14285714285714285}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 8.0, (1, 1): 1.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=12.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6666666666666666, (1, 1): 0.08333333333333333, (1, 2): 0.25}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.6666666666666666, (1, 1): 0.08333333333333333, (1, 2): 0.25}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 1): 3.0 -> 3.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 0): 8.0 -> 8.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 6.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=11.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5454545454545454, (1, 1): 0.18181818181818182, (1, 2): 0.2727272727272727}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.5454545454545454, (1, 1): 0.18181818181818182, (1, 2): 0.2727272727272727}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 6.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=11.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.18181818181818182, (0, 1): 0.5454545454545454, (0, 2): 0.2727272727272727}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.18181818181818182, (0, 1): 0.5454545454545454, (0, 2): 0.2727272727272727}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 6.0 -> 7.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 6.0 -> 7.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 13.0}
in get_filtered_urn(filter=1) --- total: total=15.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06666666666666667, (1, 1): 0.06666666666666667, (1, 2): 0.8666666666666667}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06666666666666667, (1, 1): 0.06666666666666667, (1, 2): 0.8666666666666667}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 13.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=15.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.06666666666666667, (2, 1): 0.8666666666666667, (2, 2): 0.06666666666666667}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.06666666666666667, (2, 1): 0.8666666666666667, (2, 2): 0.06666666666666667}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 13.0 -> 14.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 13.0 -> 14.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 5.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=10.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3, (2, 1): 0.5, (2, 2): 0.2}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.3, (2, 1): 0.5, (2, 2): 0.2}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 7.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=12.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.16666666666666666, (0, 1): 0.5833333333333334, (0, 2): 0.25}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.16666666666666666, (0, 1): 0.5833333333333334, (0, 2): 0.25}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 3.0 -> 3.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 7.0 -> 7.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 14.0}
in get_filtered_urn(filter=1) --- total: total=16.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0625, (1, 1): 0.0625, (1, 2): 0.875}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0625, (1, 1): 0.0625, (1, 2): 0.875}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 14.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=16.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0625, (2, 1): 0.875, (2, 2): 0.0625}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0625, (2, 1): 0.875, (2, 2): 0.0625}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 14.0 -> 15.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 14.0 -> 15.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 5.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=10.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3, (2, 1): 0.5, (2, 2): 0.2}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.3, (2, 1): 0.5, (2, 2): 0.2}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 7.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=12.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.16666666666666666, (0, 1): 0.5833333333333334, (0, 2): 0.25}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.16666666666666666, (0, 1): 0.5833333333333334, (0, 2): 0.25}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 3.0 -> 3.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 7.0 -> 7.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 15.0}
in get_filtered_urn(filter=1) --- total: total=17.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.058823529411764705, (1, 1): 0.058823529411764705, (1, 2): 0.8823529411764706}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.058823529411764705, (1, 1): 0.058823529411764705, (1, 2): 0.8823529411764706}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 15.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=17.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.058823529411764705, (2, 1): 0.8823529411764706, (2, 2): 0.058823529411764705}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.058823529411764705, (2, 1): 0.8823529411764706, (2, 2): 0.058823529411764705}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 15.0 -> 16.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 15.0 -> 16.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 5.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=10.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3, (2, 1): 0.5, (2, 2): 0.2}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.3, (2, 1): 0.5, (2, 2): 0.2}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 2.0, (1, 2): 5.0}
in get_filtered_urn(filter=1) --- total: total=11.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.36363636363636365, (1, 1): 0.18181818181818182, (1, 2): 0.45454545454545453}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.36363636363636365, (1, 1): 0.18181818181818182, (1, 2): 0.45454545454545453}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 5.0 -> 6.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 5.0 -> 6.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 3.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=7.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.42857142857142855, (2, 1): 0.42857142857142855, (2, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.42857142857142855, (2, 1): 0.42857142857142855, (2, 2): 0.14285714285714285}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=5.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.2, (0, 1): 0.2, (0, 2): 0.6}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.2, (0, 1): 0.2, (0, 2): 0.6}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 3.0 -> 4.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 3.0 -> 4.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 7.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=12.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.5833333333333334, (1, 1): 0.16666666666666666, (1, 2): 0.25}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.5833333333333334, (1, 1): 0.16666666666666666, (1, 2): 0.25}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 7.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=12.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.16666666666666666, (0, 1): 0.5833333333333334, (0, 2): 0.25}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.16666666666666666, (0, 1): 0.5833333333333334, (0, 2): 0.25}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 7.0 -> 8.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 7.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 16.0}
in get_filtered_urn(filter=1) --- total: total=18.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05555555555555555, (1, 1): 0.05555555555555555, (1, 2): 0.8888888888888888}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05555555555555555, (1, 1): 0.05555555555555555, (1, 2): 0.8888888888888888}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 16.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=18.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05555555555555555, (2, 1): 0.8888888888888888, (2, 2): 0.05555555555555555}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05555555555555555, (2, 1): 0.8888888888888888, (2, 2): 0.05555555555555555}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 16.0 -> 17.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 16.0 -> 17.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 3.0, (2, 1): 6.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=11.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.2727272727272727, (2, 1): 0.5454545454545454, (2, 2): 0.18181818181818182}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.2727272727272727, (2, 1): 0.5454545454545454, (2, 2): 0.18181818181818182}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 3.0}
in get_filtered_urn(filter=0) --- total: total=13.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.15384615384615385, (0, 1): 0.6153846153846154, (0, 2): 0.23076923076923078}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.15384615384615385, (0, 1): 0.6153846153846154, (0, 2): 0.23076923076923078}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 0): 3.0 -> 4.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 2): 3.0 -> 4.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 4.0, (2, 1): 3.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=8.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5, (2, 1): 0.375, (2, 2): 0.125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.5, (2, 1): 0.375, (2, 2): 0.125}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 4.0}
in get_filtered_urn(filter=0) --- total: total=6.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.16666666666666666, (0, 1): 0.16666666666666666, (0, 2): 0.6666666666666666}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.16666666666666666, (0, 1): 0.16666666666666666, (0, 2): 0.6666666666666666}
in decode_message(signal=0) Receiver 2 got option: (0, 1) and decoded action: 1
Receiver 2 received signals: [0] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 0): 4.0 -> 4.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 1): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 4.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=11.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.18181818181818182, (0, 1): 0.36363636363636365, (0, 2): 0.45454545454545453}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.18181818181818182, (0, 1): 0.36363636363636365, (0, 2): 0.45454545454545453}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=10.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5, (2, 1): 0.3, (2, 2): 0.2}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.5, (2, 1): 0.3, (2, 2): 0.2}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 5.0 -> 6.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 5.0 -> 6.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 8.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=10.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.1, (0, 1): 0.8, (0, 2): 0.1}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.1, (0, 1): 0.8, (0, 2): 0.1}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 8.0, (1, 1): 1.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=12.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6666666666666666, (1, 1): 0.08333333333333333, (1, 2): 0.25}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.6666666666666666, (1, 1): 0.08333333333333333, (1, 2): 0.25}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 8.0 -> 9.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 8.0 -> 9.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 4.0, (0, 2): 6.0}
in get_filtered_urn(filter=0) --- total: total=12.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.16666666666666666, (0, 1): 0.3333333333333333, (0, 2): 0.5}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.16666666666666666, (0, 1): 0.3333333333333333, (0, 2): 0.5}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 6.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=11.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5454545454545454, (2, 1): 0.2727272727272727, (2, 2): 0.18181818181818182}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.5454545454545454, (2, 1): 0.2727272727272727, (2, 2): 0.18181818181818182}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 6.0 -> 7.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 6.0 -> 7.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 4.0, (2, 1): 3.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=8.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5, (2, 1): 0.375, (2, 2): 0.125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.5, (2, 1): 0.375, (2, 2): 0.125}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 4.0}
in get_filtered_urn(filter=0) --- total: total=6.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.16666666666666666, (0, 1): 0.16666666666666666, (0, 2): 0.6666666666666666}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.16666666666666666, (0, 1): 0.16666666666666666, (0, 2): 0.6666666666666666}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 4.0 -> 5.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 4.0 -> 5.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 4.0, (2, 1): 6.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=12.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.5, (2, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.5, (2, 2): 0.16666666666666666}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 4.0}
in get_filtered_urn(filter=0) --- total: total=14.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.14285714285714285, (0, 1): 0.5714285714285714, (0, 2): 0.2857142857142857}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.14285714285714285, (0, 1): 0.5714285714285714, (0, 2): 0.2857142857142857}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 0): 4.0 -> 5.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 2): 4.0 -> 5.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 3.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=9.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5555555555555556, (2, 1): 0.3333333333333333, (2, 2): 0.1111111111111111}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.5555555555555556, (2, 1): 0.3333333333333333, (2, 2): 0.1111111111111111}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 9.0, (1, 1): 1.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=13.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6923076923076923, (1, 1): 0.07692307692307693, (1, 2): 0.23076923076923078}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.6923076923076923, (1, 1): 0.07692307692307693, (1, 2): 0.23076923076923078}
in decode_message(signal=1) Receiver 2 got option: (1, 2) and decoded action: 2
Receiver 2 received signals: [1] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 1): 3.0 -> 4.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 2): 3.0 -> 4.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 4.0, (0, 2): 7.0}
in get_filtered_urn(filter=0) --- total: total=13.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.15384615384615385, (0, 1): 0.3076923076923077, (0, 2): 0.5384615384615384}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.15384615384615385, (0, 1): 0.3076923076923077, (0, 2): 0.5384615384615384}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 2.0, (1, 2): 6.0}
in get_filtered_urn(filter=1) --- total: total=12.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3333333333333333, (1, 1): 0.16666666666666666, (1, 2): 0.5}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.3333333333333333, (1, 1): 0.16666666666666666, (1, 2): 0.5}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 6.0 -> 6.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 9.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=11.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.09090909090909091, (0, 1): 0.8181818181818182, (0, 2): 0.09090909090909091}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.09090909090909091, (0, 1): 0.8181818181818182, (0, 2): 0.09090909090909091}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 9.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=14.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6428571428571429, (1, 1): 0.07142857142857142, (1, 2): 0.2857142857142857}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.6428571428571429, (1, 1): 0.07142857142857142, (1, 2): 0.2857142857142857}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 9.0 -> 10.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 9.0 -> 10.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 8.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=13.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6153846153846154, (1, 1): 0.15384615384615385, (1, 2): 0.23076923076923078}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.6153846153846154, (1, 1): 0.15384615384615385, (1, 2): 0.23076923076923078}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 7.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=12.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5833333333333334, (2, 1): 0.25, (2, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.5833333333333334, (2, 1): 0.25, (2, 2): 0.16666666666666666}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 3.0 -> 3.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 7.0 -> 7.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=10.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5, (2, 1): 0.4, (2, 2): 0.1}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.5, (2, 1): 0.4, (2, 2): 0.1}
Sender 1 got filter 2 choose option: (2, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 17.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=19.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05263157894736842, (2, 1): 0.8947368421052632, (2, 2): 0.05263157894736842}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05263157894736842, (2, 1): 0.8947368421052632, (2, 2): 0.05263157894736842}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 2): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 1): 17.0 -> 17.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 4.0, (0, 2): 7.0}
in get_filtered_urn(filter=0) --- total: total=13.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.15384615384615385, (0, 1): 0.3076923076923077, (0, 2): 0.5384615384615384}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.15384615384615385, (0, 1): 0.3076923076923077, (0, 2): 0.5384615384615384}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 2.0, (1, 2): 6.0}
in get_filtered_urn(filter=1) --- total: total=12.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3333333333333333, (1, 1): 0.16666666666666666, (1, 2): 0.5}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.3333333333333333, (1, 1): 0.16666666666666666, (1, 2): 0.5}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 6.0 -> 6.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 10.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=12.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.08333333333333333, (0, 1): 0.8333333333333334, (0, 2): 0.08333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.08333333333333333, (0, 1): 0.8333333333333334, (0, 2): 0.08333333333333333}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=15.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6666666666666666, (1, 1): 0.06666666666666667, (1, 2): 0.26666666666666666}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.6666666666666666, (1, 1): 0.06666666666666667, (1, 2): 0.26666666666666666}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 10.0 -> 11.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 10.0 -> 11.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 8.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=13.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6153846153846154, (1, 1): 0.15384615384615385, (1, 2): 0.23076923076923078}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.6153846153846154, (1, 1): 0.15384615384615385, (1, 2): 0.23076923076923078}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=15.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.13333333333333333, (0, 1): 0.5333333333333333, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.13333333333333333, (0, 1): 0.5333333333333333, (0, 2): 0.3333333333333333}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 8.0 -> 8.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 5.0 -> 5.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=10.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5, (2, 1): 0.4, (2, 2): 0.1}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.5, (2, 1): 0.4, (2, 2): 0.1}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=7.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.14285714285714285, (0, 1): 0.14285714285714285, (0, 2): 0.7142857142857143}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.14285714285714285, (0, 1): 0.14285714285714285, (0, 2): 0.7142857142857143}
in decode_message(signal=0) Receiver 2 got option: (0, 0) and decoded action: 0
Receiver 2 received signals: [0] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 0): 5.0 -> 5.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 0): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 8.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=13.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6153846153846154, (1, 1): 0.15384615384615385, (1, 2): 0.23076923076923078}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.6153846153846154, (1, 1): 0.15384615384615385, (1, 2): 0.23076923076923078}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=15.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.13333333333333333, (0, 1): 0.5333333333333333, (0, 2): 0.3333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.13333333333333333, (0, 1): 0.5333333333333333, (0, 2): 0.3333333333333333}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 8.0 -> 9.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 8.0 -> 9.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 11.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=13.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.07692307692307693, (0, 1): 0.8461538461538461, (0, 2): 0.07692307692307693}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.07692307692307693, (0, 1): 0.8461538461538461, (0, 2): 0.07692307692307693}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 11.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=16.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6875, (1, 1): 0.0625, (1, 2): 0.25}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.6875, (1, 1): 0.0625, (1, 2): 0.25}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 11.0 -> 12.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 11.0 -> 12.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 9.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=14.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6428571428571429, (1, 1): 0.14285714285714285, (1, 2): 0.21428571428571427}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.6428571428571429, (1, 1): 0.14285714285714285, (1, 2): 0.21428571428571427}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 9.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=16.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.125, (0, 1): 0.5625, (0, 2): 0.3125}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.125, (0, 1): 0.5625, (0, 2): 0.3125}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 9.0 -> 10.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 9.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 17.0}
in get_filtered_urn(filter=1) --- total: total=19.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05263157894736842, (1, 1): 0.05263157894736842, (1, 2): 0.8947368421052632}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05263157894736842, (1, 1): 0.05263157894736842, (1, 2): 0.8947368421052632}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 17.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=19.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05263157894736842, (2, 1): 0.8947368421052632, (2, 2): 0.05263157894736842}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05263157894736842, (2, 1): 0.8947368421052632, (2, 2): 0.05263157894736842}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 17.0 -> 18.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 17.0 -> 18.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 6.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=13.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.38461538461538464, (2, 1): 0.46153846153846156, (2, 2): 0.15384615384615385}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.38461538461538464, (2, 1): 0.46153846153846156, (2, 2): 0.15384615384615385}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 7.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=12.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5833333333333334, (2, 1): 0.25, (2, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.5833333333333334, (2, 1): 0.25, (2, 2): 0.16666666666666666}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 7.0 -> 7.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 18.0}
in get_filtered_urn(filter=1) --- total: total=20.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05, (1, 1): 0.05, (1, 2): 0.9}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05, (1, 1): 0.05, (1, 2): 0.9}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 18.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=20.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05, (2, 1): 0.9, (2, 2): 0.05}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05, (2, 1): 0.9, (2, 2): 0.05}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 18.0 -> 19.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 18.0 -> 19.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 4.0, (0, 2): 7.0}
in get_filtered_urn(filter=0) --- total: total=13.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.15384615384615385, (0, 1): 0.3076923076923077, (0, 2): 0.5384615384615384}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.15384615384615385, (0, 1): 0.3076923076923077, (0, 2): 0.5384615384615384}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 4.0, (1, 1): 2.0, (1, 2): 6.0}
in get_filtered_urn(filter=1) --- total: total=12.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3333333333333333, (1, 1): 0.16666666666666666, (1, 2): 0.5}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.3333333333333333, (1, 1): 0.16666666666666666, (1, 2): 0.5}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 1): 4.0 -> 5.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 0): 4.0 -> 5.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=10.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5, (2, 1): 0.4, (2, 2): 0.1}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.5, (2, 1): 0.4, (2, 2): 0.1}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=7.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.14285714285714285, (0, 1): 0.14285714285714285, (0, 2): 0.7142857142857143}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.14285714285714285, (0, 1): 0.14285714285714285, (0, 2): 0.7142857142857143}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 5.0 -> 6.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 5.0 -> 6.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 5.0, (0, 2): 7.0}
in get_filtered_urn(filter=0) --- total: total=14.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.14285714285714285, (0, 1): 0.35714285714285715, (0, 2): 0.5}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.14285714285714285, (0, 1): 0.35714285714285715, (0, 2): 0.5}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 5.0, (1, 1): 2.0, (1, 2): 6.0}
in get_filtered_urn(filter=1) --- total: total=13.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.38461538461538464, (1, 1): 0.15384615384615385, (1, 2): 0.46153846153846156}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.38461538461538464, (1, 1): 0.15384615384615385, (1, 2): 0.46153846153846156}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 1): 5.0 -> 6.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 0): 5.0 -> 6.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 19.0}
in get_filtered_urn(filter=1) --- total: total=21.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.047619047619047616, (1, 1): 0.047619047619047616, (1, 2): 0.9047619047619048}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.047619047619047616, (1, 1): 0.047619047619047616, (1, 2): 0.9047619047619048}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 19.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=21.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.047619047619047616, (2, 1): 0.9047619047619048, (2, 2): 0.047619047619047616}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.047619047619047616, (2, 1): 0.9047619047619048, (2, 2): 0.047619047619047616}
in decode_message(signal=2) Receiver 2 got option: (2, 2) and decoded action: 2
Receiver 2 received signals: [2] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (1, 2): 19.0 -> 19.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 2): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 6.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=13.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.38461538461538464, (2, 1): 0.46153846153846156, (2, 2): 0.15384615384615385}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.38461538461538464, (2, 1): 0.46153846153846156, (2, 2): 0.15384615384615385}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=17.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.11764705882352941, (0, 1): 0.5882352941176471, (0, 2): 0.29411764705882354}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.11764705882352941, (0, 1): 0.5882352941176471, (0, 2): 0.29411764705882354}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 5.0 -> 5.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 19.0}
in get_filtered_urn(filter=1) --- total: total=21.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.047619047619047616, (1, 1): 0.047619047619047616, (1, 2): 0.9047619047619048}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.047619047619047616, (1, 1): 0.047619047619047616, (1, 2): 0.9047619047619048}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 19.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=21.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.047619047619047616, (2, 1): 0.9047619047619048, (2, 2): 0.047619047619047616}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.047619047619047616, (2, 1): 0.9047619047619048, (2, 2): 0.047619047619047616}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 19.0 -> 20.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 19.0 -> 20.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 6.0, (0, 2): 7.0}
in get_filtered_urn(filter=0) --- total: total=15.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.13333333333333333, (0, 1): 0.4, (0, 2): 0.4666666666666667}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.13333333333333333, (0, 1): 0.4, (0, 2): 0.4666666666666667}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 6.0, (1, 1): 2.0, (1, 2): 6.0}
in get_filtered_urn(filter=1) --- total: total=14.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.42857142857142855, (1, 1): 0.14285714285714285, (1, 2): 0.42857142857142855}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.42857142857142855, (1, 1): 0.14285714285714285, (1, 2): 0.42857142857142855}
in decode_message(signal=1) Receiver 5 got option: (1, 1) and decoded action: 1
Receiver 5 received signals: [1] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 6.0 -> 6.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 1): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 12.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=14.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.07142857142857142, (0, 1): 0.8571428571428571, (0, 2): 0.07142857142857142}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.07142857142857142, (0, 1): 0.8571428571428571, (0, 2): 0.07142857142857142}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 12.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=17.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7058823529411765, (1, 1): 0.058823529411764705, (1, 2): 0.23529411764705882}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7058823529411765, (1, 1): 0.058823529411764705, (1, 2): 0.23529411764705882}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 12.0 -> 13.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 12.0 -> 13.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 6.0, (0, 2): 7.0}
in get_filtered_urn(filter=0) --- total: total=15.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.13333333333333333, (0, 1): 0.4, (0, 2): 0.4666666666666667}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.13333333333333333, (0, 1): 0.4, (0, 2): 0.4666666666666667}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 6.0, (1, 1): 2.0, (1, 2): 6.0}
in get_filtered_urn(filter=1) --- total: total=14.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.42857142857142855, (1, 1): 0.14285714285714285, (1, 2): 0.42857142857142855}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.42857142857142855, (1, 1): 0.14285714285714285, (1, 2): 0.42857142857142855}
in decode_message(signal=1) Receiver 5 got option: (1, 1) and decoded action: 1
Receiver 5 received signals: [1] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 6.0 -> 6.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 1): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 13.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=15.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.06666666666666667, (0, 1): 0.8666666666666667, (0, 2): 0.06666666666666667}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.06666666666666667, (0, 1): 0.8666666666666667, (0, 2): 0.06666666666666667}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 13.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=18.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7222222222222222, (1, 1): 0.05555555555555555, (1, 2): 0.2222222222222222}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.7222222222222222, (1, 1): 0.05555555555555555, (1, 2): 0.2222222222222222}
in decode_message(signal=1) Receiver 2 got option: (1, 1) and decoded action: 1
Receiver 2 received signals: [1] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 1): 13.0 -> 13.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 1): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 6.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=13.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.38461538461538464, (2, 1): 0.46153846153846156, (2, 2): 0.15384615384615385}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.38461538461538464, (2, 1): 0.46153846153846156, (2, 2): 0.15384615384615385}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 6.0, (1, 1): 2.0, (1, 2): 6.0}
in get_filtered_urn(filter=1) --- total: total=14.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.42857142857142855, (1, 1): 0.14285714285714285, (1, 2): 0.42857142857142855}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.42857142857142855, (1, 1): 0.14285714285714285, (1, 2): 0.42857142857142855}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 6.0 -> 6.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 6.0 -> 6.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 13.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=15.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.06666666666666667, (0, 1): 0.8666666666666667, (0, 2): 0.06666666666666667}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.06666666666666667, (0, 1): 0.8666666666666667, (0, 2): 0.06666666666666667}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 13.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=18.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7222222222222222, (1, 1): 0.05555555555555555, (1, 2): 0.2222222222222222}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7222222222222222, (1, 1): 0.05555555555555555, (1, 2): 0.2222222222222222}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 13.0 -> 14.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 13.0 -> 14.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=15.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6666666666666666, (1, 1): 0.13333333333333333, (1, 2): 0.2}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.6666666666666666, (1, 1): 0.13333333333333333, (1, 2): 0.2}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=17.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.11764705882352941, (0, 1): 0.5882352941176471, (0, 2): 0.29411764705882354}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.11764705882352941, (0, 1): 0.5882352941176471, (0, 2): 0.29411764705882354}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 10.0 -> 11.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 10.0 -> 11.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 20.0}
in get_filtered_urn(filter=1) --- total: total=22.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.045454545454545456, (1, 1): 0.045454545454545456, (1, 2): 0.9090909090909091}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.045454545454545456, (1, 1): 0.045454545454545456, (1, 2): 0.9090909090909091}
Sender 1 got filter 1 choose option: (1, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 14.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=19.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7368421052631579, (1, 1): 0.05263157894736842, (1, 2): 0.21052631578947367}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7368421052631579, (1, 1): 0.05263157894736842, (1, 2): 0.21052631578947367}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (1, 1): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 0): 14.0 -> 14.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 6.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=13.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.38461538461538464, (2, 1): 0.46153846153846156, (2, 2): 0.15384615384615385}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.38461538461538464, (2, 1): 0.46153846153846156, (2, 2): 0.15384615384615385}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 7.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=12.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5833333333333334, (2, 1): 0.25, (2, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.5833333333333334, (2, 1): 0.25, (2, 2): 0.16666666666666666}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 7.0 -> 7.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 6.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=11.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5454545454545454, (2, 1): 0.36363636363636365, (2, 2): 0.09090909090909091}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.5454545454545454, (2, 1): 0.36363636363636365, (2, 2): 0.09090909090909091}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 6.0}
in get_filtered_urn(filter=0) --- total: total=8.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.125, (0, 1): 0.125, (0, 2): 0.75}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.125, (0, 1): 0.125, (0, 2): 0.75}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 6.0 -> 7.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 6.0 -> 7.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 6.0, (0, 2): 7.0}
in get_filtered_urn(filter=0) --- total: total=15.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.13333333333333333, (0, 1): 0.4, (0, 2): 0.4666666666666667}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.13333333333333333, (0, 1): 0.4, (0, 2): 0.4666666666666667}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 7.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=12.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5833333333333334, (2, 1): 0.25, (2, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.5833333333333334, (2, 1): 0.25, (2, 2): 0.16666666666666666}
in decode_message(signal=2) Receiver 5 got option: (2, 1) and decoded action: 1
Receiver 5 received signals: [2] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 2): 7.0 -> 7.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 1): 3.0 -> 3.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 7.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=12.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5833333333333334, (2, 1): 0.3333333333333333, (2, 2): 0.08333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.5833333333333334, (2, 1): 0.3333333333333333, (2, 2): 0.08333333333333333}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 14.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=19.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7368421052631579, (1, 1): 0.05263157894736842, (1, 2): 0.21052631578947367}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7368421052631579, (1, 1): 0.05263157894736842, (1, 2): 0.21052631578947367}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 1): 4.0 -> 4.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 0): 14.0 -> 14.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 6.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=13.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.38461538461538464, (2, 1): 0.46153846153846156, (2, 2): 0.15384615384615385}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.38461538461538464, (2, 1): 0.46153846153846156, (2, 2): 0.15384615384615385}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 6.0, (1, 1): 2.0, (1, 2): 6.0}
in get_filtered_urn(filter=1) --- total: total=14.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.42857142857142855, (1, 1): 0.14285714285714285, (1, 2): 0.42857142857142855}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.42857142857142855, (1, 1): 0.14285714285714285, (1, 2): 0.42857142857142855}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 6.0 -> 6.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 6.0 -> 6.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 14.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=16.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0625, (0, 1): 0.875, (0, 2): 0.0625}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0625, (0, 1): 0.875, (0, 2): 0.0625}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 14.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=19.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7368421052631579, (1, 1): 0.05263157894736842, (1, 2): 0.21052631578947367}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7368421052631579, (1, 1): 0.05263157894736842, (1, 2): 0.21052631578947367}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 14.0 -> 15.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 14.0 -> 15.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 11.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=16.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.6875, (1, 1): 0.125, (1, 2): 0.1875}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.6875, (1, 1): 0.125, (1, 2): 0.1875}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 11.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=18.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.1111111111111111, (0, 1): 0.6111111111111112, (0, 2): 0.2777777777777778}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.1111111111111111, (0, 1): 0.6111111111111112, (0, 2): 0.2777777777777778}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 11.0 -> 12.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 11.0 -> 12.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 15.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=17.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.058823529411764705, (0, 1): 0.8823529411764706, (0, 2): 0.058823529411764705}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.058823529411764705, (0, 1): 0.8823529411764706, (0, 2): 0.058823529411764705}
Sender 1 got filter 0 choose option: (0, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 7.0}
in get_filtered_urn(filter=0) --- total: total=9.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.1111111111111111, (0, 1): 0.1111111111111111, (0, 2): 0.7777777777777778}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.1111111111111111, (0, 1): 0.1111111111111111, (0, 2): 0.7777777777777778}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 0): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 2): 7.0 -> 7.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 6.0, (0, 2): 7.0}
in get_filtered_urn(filter=0) --- total: total=15.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.13333333333333333, (0, 1): 0.4, (0, 2): 0.4666666666666667}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.13333333333333333, (0, 1): 0.4, (0, 2): 0.4666666666666667}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 7.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=12.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5833333333333334, (2, 1): 0.25, (2, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.5833333333333334, (2, 1): 0.25, (2, 2): 0.16666666666666666}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 7.0 -> 8.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 7.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 7.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=12.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.5833333333333334, (2, 1): 0.3333333333333333, (2, 2): 0.08333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.5833333333333334, (2, 1): 0.3333333333333333, (2, 2): 0.08333333333333333}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 7.0}
in get_filtered_urn(filter=0) --- total: total=9.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.1111111111111111, (0, 1): 0.1111111111111111, (0, 2): 0.7777777777777778}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.1111111111111111, (0, 1): 0.1111111111111111, (0, 2): 0.7777777777777778}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 7.0 -> 8.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 7.0 -> 8.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 12.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=17.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7058823529411765, (1, 1): 0.11764705882352941, (1, 2): 0.17647058823529413}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7058823529411765, (1, 1): 0.11764705882352941, (1, 2): 0.17647058823529413}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 12.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=19.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.10526315789473684, (0, 1): 0.631578947368421, (0, 2): 0.2631578947368421}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.10526315789473684, (0, 1): 0.631578947368421, (0, 2): 0.2631578947368421}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 12.0 -> 12.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 5.0 -> 5.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 20.0}
in get_filtered_urn(filter=1) --- total: total=22.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.045454545454545456, (1, 1): 0.045454545454545456, (1, 2): 0.9090909090909091}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.045454545454545456, (1, 1): 0.045454545454545456, (1, 2): 0.9090909090909091}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 20.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=22.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.045454545454545456, (2, 1): 0.9090909090909091, (2, 2): 0.045454545454545456}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.045454545454545456, (2, 1): 0.9090909090909091, (2, 2): 0.045454545454545456}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 20.0 -> 21.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 20.0 -> 21.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 6.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=16.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.125, (0, 1): 0.375, (0, 2): 0.5}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.125, (0, 1): 0.375, (0, 2): 0.5}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 6.0, (1, 1): 2.0, (1, 2): 6.0}
in get_filtered_urn(filter=1) --- total: total=14.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.42857142857142855, (1, 1): 0.14285714285714285, (1, 2): 0.42857142857142855}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.42857142857142855, (1, 1): 0.14285714285714285, (1, 2): 0.42857142857142855}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 1): 6.0 -> 7.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 0): 6.0 -> 7.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 15.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=17.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.058823529411764705, (0, 1): 0.8823529411764706, (0, 2): 0.058823529411764705}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.058823529411764705, (0, 1): 0.8823529411764706, (0, 2): 0.058823529411764705}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 15.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=20.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.75, (1, 1): 0.05, (1, 2): 0.2}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.75, (1, 1): 0.05, (1, 2): 0.2}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 15.0 -> 16.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 15.0 -> 16.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 6.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=13.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.38461538461538464, (2, 1): 0.46153846153846156, (2, 2): 0.15384615384615385}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.38461538461538464, (2, 1): 0.46153846153846156, (2, 2): 0.15384615384615385}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 7.0, (1, 1): 2.0, (1, 2): 6.0}
in get_filtered_urn(filter=1) --- total: total=15.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.4666666666666667, (1, 1): 0.13333333333333333, (1, 2): 0.4}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.4666666666666667, (1, 1): 0.13333333333333333, (1, 2): 0.4}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 6.0 -> 6.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 7.0 -> 7.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 21.0}
in get_filtered_urn(filter=1) --- total: total=23.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.043478260869565216, (1, 1): 0.043478260869565216, (1, 2): 0.9130434782608695}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.043478260869565216, (1, 1): 0.043478260869565216, (1, 2): 0.9130434782608695}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 21.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=23.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.043478260869565216, (2, 1): 0.9130434782608695, (2, 2): 0.043478260869565216}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.043478260869565216, (2, 1): 0.9130434782608695, (2, 2): 0.043478260869565216}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 21.0 -> 22.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 21.0 -> 22.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 6.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=13.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.38461538461538464, (2, 1): 0.46153846153846156, (2, 2): 0.15384615384615385}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.38461538461538464, (2, 1): 0.46153846153846156, (2, 2): 0.15384615384615385}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=13.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.6153846153846154, (2, 1): 0.23076923076923078, (2, 2): 0.15384615384615385}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.6153846153846154, (2, 1): 0.23076923076923078, (2, 2): 0.15384615384615385}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 8.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 16.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=18.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05555555555555555, (0, 1): 0.8888888888888888, (0, 2): 0.05555555555555555}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.05555555555555555, (0, 1): 0.8888888888888888, (0, 2): 0.05555555555555555}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 16.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=21.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7619047619047619, (1, 1): 0.047619047619047616, (1, 2): 0.19047619047619047}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7619047619047619, (1, 1): 0.047619047619047616, (1, 2): 0.19047619047619047}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 16.0 -> 17.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 16.0 -> 17.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 7.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=17.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.11764705882352941, (0, 1): 0.4117647058823529, (0, 2): 0.47058823529411764}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.11764705882352941, (0, 1): 0.4117647058823529, (0, 2): 0.47058823529411764}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=13.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.6153846153846154, (2, 1): 0.23076923076923078, (2, 2): 0.15384615384615385}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.6153846153846154, (2, 1): 0.23076923076923078, (2, 2): 0.15384615384615385}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 8.0 -> 9.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 8.0 -> 9.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 22.0}
in get_filtered_urn(filter=1) --- total: total=24.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.041666666666666664, (1, 1): 0.041666666666666664, (1, 2): 0.9166666666666666}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.041666666666666664, (1, 1): 0.041666666666666664, (1, 2): 0.9166666666666666}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 22.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=24.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.041666666666666664, (2, 1): 0.9166666666666666, (2, 2): 0.041666666666666664}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.041666666666666664, (2, 1): 0.9166666666666666, (2, 2): 0.041666666666666664}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 22.0 -> 23.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 22.0 -> 23.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 6.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=13.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.38461538461538464, (2, 1): 0.46153846153846156, (2, 2): 0.15384615384615385}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.38461538461538464, (2, 1): 0.46153846153846156, (2, 2): 0.15384615384615385}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 7.0, (1, 1): 2.0, (1, 2): 6.0}
in get_filtered_urn(filter=1) --- total: total=15.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.4666666666666667, (1, 1): 0.13333333333333333, (1, 2): 0.4}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.4666666666666667, (1, 1): 0.13333333333333333, (1, 2): 0.4}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 6.0 -> 7.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 6.0 -> 7.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 17.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=19.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05263157894736842, (0, 1): 0.8947368421052632, (0, 2): 0.05263157894736842}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.05263157894736842, (0, 1): 0.8947368421052632, (0, 2): 0.05263157894736842}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 17.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=22.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7727272727272727, (1, 1): 0.045454545454545456, (1, 2): 0.18181818181818182}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7727272727272727, (1, 1): 0.045454545454545456, (1, 2): 0.18181818181818182}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 17.0 -> 18.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 17.0 -> 18.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 7.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=18.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.1111111111111111, (0, 1): 0.3888888888888889, (0, 2): 0.5}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.1111111111111111, (0, 1): 0.3888888888888889, (0, 2): 0.5}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=14.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.6428571428571429, (2, 1): 0.21428571428571427, (2, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.6428571428571429, (2, 1): 0.21428571428571427, (2, 2): 0.14285714285714285}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 9.0 -> 10.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 9.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 23.0}
in get_filtered_urn(filter=1) --- total: total=25.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04, (1, 1): 0.04, (1, 2): 0.92}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04, (1, 1): 0.04, (1, 2): 0.92}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 23.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=25.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04, (2, 1): 0.92, (2, 2): 0.04}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04, (2, 1): 0.92, (2, 2): 0.04}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 23.0 -> 24.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 23.0 -> 24.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 12.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=17.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7058823529411765, (1, 1): 0.11764705882352941, (1, 2): 0.17647058823529413}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7058823529411765, (1, 1): 0.11764705882352941, (1, 2): 0.17647058823529413}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 12.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=19.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.10526315789473684, (0, 1): 0.631578947368421, (0, 2): 0.2631578947368421}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.10526315789473684, (0, 1): 0.631578947368421, (0, 2): 0.2631578947368421}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 12.0 -> 12.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 5.0 -> 5.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 18.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=20.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05, (0, 1): 0.9, (0, 2): 0.05}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.05, (0, 1): 0.9, (0, 2): 0.05}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 18.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=23.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.782608695652174, (1, 1): 0.043478260869565216, (1, 2): 0.17391304347826086}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.782608695652174, (1, 1): 0.043478260869565216, (1, 2): 0.17391304347826086}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 18.0 -> 19.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 18.0 -> 19.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 7.0, (0, 2): 10.0}
in get_filtered_urn(filter=0) --- total: total=19.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.10526315789473684, (0, 1): 0.3684210526315789, (0, 2): 0.5263157894736842}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.10526315789473684, (0, 1): 0.3684210526315789, (0, 2): 0.5263157894736842}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 10.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=15.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.6666666666666666, (2, 1): 0.2, (2, 2): 0.13333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.6666666666666666, (2, 1): 0.2, (2, 2): 0.13333333333333333}
in decode_message(signal=2) Receiver 5 got option: (2, 1) and decoded action: 1
Receiver 5 received signals: [2] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 2): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 1): 3.0 -> 3.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 24.0}
in get_filtered_urn(filter=1) --- total: total=26.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.038461538461538464, (1, 1): 0.038461538461538464, (1, 2): 0.9230769230769231}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.038461538461538464, (1, 1): 0.038461538461538464, (1, 2): 0.9230769230769231}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 24.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=26.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.038461538461538464, (2, 1): 0.9230769230769231, (2, 2): 0.038461538461538464}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.038461538461538464, (2, 1): 0.9230769230769231, (2, 2): 0.038461538461538464}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 24.0 -> 25.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 24.0 -> 25.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 7.0, (0, 2): 10.0}
in get_filtered_urn(filter=0) --- total: total=19.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.10526315789473684, (0, 1): 0.3684210526315789, (0, 2): 0.5263157894736842}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.10526315789473684, (0, 1): 0.3684210526315789, (0, 2): 0.5263157894736842}
Sender 4 got filter 0 choose option: (0, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 12.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=19.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.10526315789473684, (0, 1): 0.631578947368421, (0, 2): 0.2631578947368421}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.10526315789473684, (0, 1): 0.631578947368421, (0, 2): 0.2631578947368421}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 0): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 5.0 -> 5.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=13.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.6153846153846154, (2, 1): 0.3076923076923077, (2, 2): 0.07692307692307693}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.6153846153846154, (2, 1): 0.3076923076923077, (2, 2): 0.07692307692307693}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=10.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.1, (0, 1): 0.1, (0, 2): 0.8}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.1, (0, 1): 0.1, (0, 2): 0.8}
in decode_message(signal=0) Receiver 2 got option: (0, 1) and decoded action: 1
Receiver 2 received signals: [0] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 0): 8.0 -> 8.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 1): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 7.0, (0, 2): 10.0}
in get_filtered_urn(filter=0) --- total: total=19.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.10526315789473684, (0, 1): 0.3684210526315789, (0, 2): 0.5263157894736842}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.10526315789473684, (0, 1): 0.3684210526315789, (0, 2): 0.5263157894736842}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 10.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=15.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.6666666666666666, (2, 1): 0.2, (2, 2): 0.13333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.6666666666666666, (2, 1): 0.2, (2, 2): 0.13333333333333333}
in decode_message(signal=2) Receiver 5 got option: (2, 1) and decoded action: 1
Receiver 5 received signals: [2] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 2): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 1): 3.0 -> 3.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=13.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.6153846153846154, (2, 1): 0.3076923076923077, (2, 2): 0.07692307692307693}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.6153846153846154, (2, 1): 0.3076923076923077, (2, 2): 0.07692307692307693}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=10.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.1, (0, 1): 0.1, (0, 2): 0.8}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.1, (0, 1): 0.1, (0, 2): 0.8}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 8.0 -> 9.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 8.0 -> 9.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 12.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=17.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7058823529411765, (1, 1): 0.11764705882352941, (1, 2): 0.17647058823529413}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7058823529411765, (1, 1): 0.11764705882352941, (1, 2): 0.17647058823529413}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 12.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=19.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.10526315789473684, (0, 1): 0.631578947368421, (0, 2): 0.2631578947368421}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.10526315789473684, (0, 1): 0.631578947368421, (0, 2): 0.2631578947368421}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 12.0 -> 13.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 12.0 -> 13.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 19.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=21.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.047619047619047616, (0, 1): 0.9047619047619048, (0, 2): 0.047619047619047616}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.047619047619047616, (0, 1): 0.9047619047619048, (0, 2): 0.047619047619047616}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 19.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=24.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7916666666666666, (1, 1): 0.041666666666666664, (1, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7916666666666666, (1, 1): 0.041666666666666664, (1, 2): 0.16666666666666666}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 19.0 -> 20.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 19.0 -> 20.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 7.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=14.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.35714285714285715, (2, 1): 0.5, (2, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.35714285714285715, (2, 1): 0.5, (2, 2): 0.14285714285714285}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 7.0, (1, 1): 2.0, (1, 2): 7.0}
in get_filtered_urn(filter=1) --- total: total=16.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.4375, (1, 1): 0.125, (1, 2): 0.4375}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.4375, (1, 1): 0.125, (1, 2): 0.4375}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 7.0 -> 8.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 7.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=14.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.6428571428571429, (2, 1): 0.2857142857142857, (2, 2): 0.07142857142857142}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.6428571428571429, (2, 1): 0.2857142857142857, (2, 2): 0.07142857142857142}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=11.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.09090909090909091, (0, 1): 0.09090909090909091, (0, 2): 0.8181818181818182}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.09090909090909091, (0, 1): 0.09090909090909091, (0, 2): 0.8181818181818182}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 9.0 -> 10.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 9.0 -> 10.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 13.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=18.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7222222222222222, (1, 1): 0.1111111111111111, (1, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.7222222222222222, (1, 1): 0.1111111111111111, (1, 2): 0.16666666666666666}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 10.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=15.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.6666666666666666, (2, 1): 0.2, (2, 2): 0.13333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.6666666666666666, (2, 1): 0.2, (2, 2): 0.13333333333333333}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 3.0 -> 3.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 10.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=15.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.6666666666666666, (2, 1): 0.26666666666666666, (2, 2): 0.06666666666666667}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.6666666666666666, (2, 1): 0.26666666666666666, (2, 2): 0.06666666666666667}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 10.0}
in get_filtered_urn(filter=0) --- total: total=12.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.08333333333333333, (0, 1): 0.08333333333333333, (0, 2): 0.8333333333333334}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.08333333333333333, (0, 1): 0.08333333333333333, (0, 2): 0.8333333333333334}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 10.0 -> 11.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 10.0 -> 11.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 13.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=18.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7222222222222222, (1, 1): 0.1111111111111111, (1, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7222222222222222, (1, 1): 0.1111111111111111, (1, 2): 0.16666666666666666}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 13.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=20.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.1, (0, 1): 0.65, (0, 2): 0.25}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.1, (0, 1): 0.65, (0, 2): 0.25}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 13.0 -> 14.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 13.0 -> 14.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 25.0}
in get_filtered_urn(filter=1) --- total: total=27.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.037037037037037035, (1, 1): 0.037037037037037035, (1, 2): 0.9259259259259259}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.037037037037037035, (1, 1): 0.037037037037037035, (1, 2): 0.9259259259259259}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 25.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=27.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.037037037037037035, (2, 1): 0.9259259259259259, (2, 2): 0.037037037037037035}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.037037037037037035, (2, 1): 0.9259259259259259, (2, 2): 0.037037037037037035}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 25.0 -> 26.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 25.0 -> 26.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 14.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=19.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7368421052631579, (1, 1): 0.10526315789473684, (1, 2): 0.15789473684210525}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.7368421052631579, (1, 1): 0.10526315789473684, (1, 2): 0.15789473684210525}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 10.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=15.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.6666666666666666, (2, 1): 0.2, (2, 2): 0.13333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.6666666666666666, (2, 1): 0.2, (2, 2): 0.13333333333333333}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 3.0 -> 3.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 26.0}
in get_filtered_urn(filter=1) --- total: total=28.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.03571428571428571, (1, 1): 0.03571428571428571, (1, 2): 0.9285714285714286}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.03571428571428571, (1, 1): 0.03571428571428571, (1, 2): 0.9285714285714286}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 26.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=28.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.03571428571428571, (2, 1): 0.9285714285714286, (2, 2): 0.03571428571428571}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.03571428571428571, (2, 1): 0.9285714285714286, (2, 2): 0.03571428571428571}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 26.0 -> 27.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 26.0 -> 27.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 8.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=15.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3333333333333333, (2, 1): 0.5333333333333333, (2, 2): 0.13333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.3333333333333333, (2, 1): 0.5333333333333333, (2, 2): 0.13333333333333333}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 7.0, (1, 1): 2.0, (1, 2): 8.0}
in get_filtered_urn(filter=1) --- total: total=17.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.4117647058823529, (1, 1): 0.11764705882352941, (1, 2): 0.47058823529411764}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.4117647058823529, (1, 1): 0.11764705882352941, (1, 2): 0.47058823529411764}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 8.0 -> 9.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 8.0 -> 9.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 27.0}
in get_filtered_urn(filter=1) --- total: total=29.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.034482758620689655, (1, 1): 0.034482758620689655, (1, 2): 0.9310344827586207}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.034482758620689655, (1, 1): 0.034482758620689655, (1, 2): 0.9310344827586207}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 27.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=29.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.034482758620689655, (2, 1): 0.9310344827586207, (2, 2): 0.034482758620689655}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.034482758620689655, (2, 1): 0.9310344827586207, (2, 2): 0.034482758620689655}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 27.0 -> 28.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 27.0 -> 28.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 14.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=19.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7368421052631579, (1, 1): 0.10526315789473684, (1, 2): 0.15789473684210525}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7368421052631579, (1, 1): 0.10526315789473684, (1, 2): 0.15789473684210525}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 14.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=21.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.09523809523809523, (0, 1): 0.6666666666666666, (0, 2): 0.23809523809523808}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.09523809523809523, (0, 1): 0.6666666666666666, (0, 2): 0.23809523809523808}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 14.0 -> 15.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 14.0 -> 15.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 20.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=22.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.045454545454545456, (0, 1): 0.9090909090909091, (0, 2): 0.045454545454545456}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.045454545454545456, (0, 1): 0.9090909090909091, (0, 2): 0.045454545454545456}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 20.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=25.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8, (1, 1): 0.04, (1, 2): 0.16}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8, (1, 1): 0.04, (1, 2): 0.16}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 20.0 -> 21.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 20.0 -> 21.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 9.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=16.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3125, (2, 1): 0.5625, (2, 2): 0.125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.3125, (2, 1): 0.5625, (2, 2): 0.125}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 10.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=15.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.6666666666666666, (2, 1): 0.2, (2, 2): 0.13333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.6666666666666666, (2, 1): 0.2, (2, 2): 0.13333333333333333}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 28.0}
in get_filtered_urn(filter=1) --- total: total=30.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.03333333333333333, (1, 1): 0.03333333333333333, (1, 2): 0.9333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.03333333333333333, (1, 1): 0.03333333333333333, (1, 2): 0.9333333333333333}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 28.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=30.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.03333333333333333, (2, 1): 0.9333333333333333, (2, 2): 0.03333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.03333333333333333, (2, 1): 0.9333333333333333, (2, 2): 0.03333333333333333}
in decode_message(signal=2) Receiver 2 got option: (2, 2) and decoded action: 2
Receiver 2 received signals: [2] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (1, 2): 28.0 -> 28.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 2): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 9.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=16.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3125, (2, 1): 0.5625, (2, 2): 0.125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.3125, (2, 1): 0.5625, (2, 2): 0.125}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 10.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=15.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.6666666666666666, (2, 1): 0.2, (2, 2): 0.13333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.6666666666666666, (2, 1): 0.2, (2, 2): 0.13333333333333333}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 11.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=16.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.6875, (2, 1): 0.25, (2, 2): 0.0625}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.6875, (2, 1): 0.25, (2, 2): 0.0625}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 11.0}
in get_filtered_urn(filter=0) --- total: total=13.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.07692307692307693, (0, 1): 0.07692307692307693, (0, 2): 0.8461538461538461}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.07692307692307693, (0, 1): 0.07692307692307693, (0, 2): 0.8461538461538461}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 11.0 -> 12.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 11.0 -> 12.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 7.0, (0, 2): 10.0}
in get_filtered_urn(filter=0) --- total: total=19.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.10526315789473684, (0, 1): 0.3684210526315789, (0, 2): 0.5263157894736842}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.10526315789473684, (0, 1): 0.3684210526315789, (0, 2): 0.5263157894736842}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 10.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=15.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.6666666666666666, (2, 1): 0.2, (2, 2): 0.13333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.6666666666666666, (2, 1): 0.2, (2, 2): 0.13333333333333333}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 10.0 -> 11.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 10.0 -> 11.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 21.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=23.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.043478260869565216, (0, 1): 0.9130434782608695, (0, 2): 0.043478260869565216}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.043478260869565216, (0, 1): 0.9130434782608695, (0, 2): 0.043478260869565216}
Sender 1 got filter 0 choose option: (0, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 12.0}
in get_filtered_urn(filter=0) --- total: total=14.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.07142857142857142, (0, 1): 0.07142857142857142, (0, 2): 0.8571428571428571}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.07142857142857142, (0, 1): 0.07142857142857142, (0, 2): 0.8571428571428571}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 0): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 2): 12.0 -> 12.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 7.0, (0, 2): 11.0}
in get_filtered_urn(filter=0) --- total: total=20.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.1, (0, 1): 0.35, (0, 2): 0.55}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.1, (0, 1): 0.35, (0, 2): 0.55}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 11.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=16.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.6875, (2, 1): 0.1875, (2, 2): 0.125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.6875, (2, 1): 0.1875, (2, 2): 0.125}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 11.0 -> 12.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 11.0 -> 12.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 12.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=17.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.7058823529411765, (2, 1): 0.23529411764705882, (2, 2): 0.058823529411764705}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.7058823529411765, (2, 1): 0.23529411764705882, (2, 2): 0.058823529411764705}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 12.0}
in get_filtered_urn(filter=0) --- total: total=14.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.07142857142857142, (0, 1): 0.07142857142857142, (0, 2): 0.8571428571428571}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.07142857142857142, (0, 1): 0.07142857142857142, (0, 2): 0.8571428571428571}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 12.0 -> 13.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 12.0 -> 13.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 9.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=16.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3125, (2, 1): 0.5625, (2, 2): 0.125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.3125, (2, 1): 0.5625, (2, 2): 0.125}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 7.0, (1, 1): 2.0, (1, 2): 9.0}
in get_filtered_urn(filter=1) --- total: total=18.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3888888888888889, (1, 1): 0.1111111111111111, (1, 2): 0.5}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.3888888888888889, (1, 1): 0.1111111111111111, (1, 2): 0.5}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 9.0 -> 9.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 7.0 -> 7.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 13.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=18.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.7222222222222222, (2, 1): 0.2222222222222222, (2, 2): 0.05555555555555555}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.7222222222222222, (2, 1): 0.2222222222222222, (2, 2): 0.05555555555555555}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 13.0}
in get_filtered_urn(filter=0) --- total: total=15.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.06666666666666667, (0, 1): 0.06666666666666667, (0, 2): 0.8666666666666667}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.06666666666666667, (0, 1): 0.06666666666666667, (0, 2): 0.8666666666666667}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 13.0 -> 14.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 13.0 -> 14.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 9.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=16.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.3125, (2, 1): 0.5625, (2, 2): 0.125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.3125, (2, 1): 0.5625, (2, 2): 0.125}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 7.0, (1, 1): 2.0, (1, 2): 9.0}
in get_filtered_urn(filter=1) --- total: total=18.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3888888888888889, (1, 1): 0.1111111111111111, (1, 2): 0.5}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.3888888888888889, (1, 1): 0.1111111111111111, (1, 2): 0.5}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 9.0 -> 10.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 9.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 21.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=23.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.043478260869565216, (0, 1): 0.9130434782608695, (0, 2): 0.043478260869565216}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.043478260869565216, (0, 1): 0.9130434782608695, (0, 2): 0.043478260869565216}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 21.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=26.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8076923076923077, (1, 1): 0.038461538461538464, (1, 2): 0.15384615384615385}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8076923076923077, (1, 1): 0.038461538461538464, (1, 2): 0.15384615384615385}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 21.0 -> 22.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 21.0 -> 22.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 10.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=17.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.29411764705882354, (2, 1): 0.5882352941176471, (2, 2): 0.11764705882352941}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.29411764705882354, (2, 1): 0.5882352941176471, (2, 2): 0.11764705882352941}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 7.0, (1, 1): 2.0, (1, 2): 10.0}
in get_filtered_urn(filter=1) --- total: total=19.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3684210526315789, (1, 1): 0.10526315789473684, (1, 2): 0.5263157894736842}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.3684210526315789, (1, 1): 0.10526315789473684, (1, 2): 0.5263157894736842}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 10.0 -> 11.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 10.0 -> 11.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 22.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=24.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.041666666666666664, (0, 1): 0.9166666666666666, (0, 2): 0.041666666666666664}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.041666666666666664, (0, 1): 0.9166666666666666, (0, 2): 0.041666666666666664}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 22.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=27.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8148148148148148, (1, 1): 0.037037037037037035, (1, 2): 0.14814814814814814}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8148148148148148, (1, 1): 0.037037037037037035, (1, 2): 0.14814814814814814}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 22.0 -> 23.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 22.0 -> 23.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 11.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=18.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.2777777777777778, (2, 1): 0.6111111111111112, (2, 2): 0.1111111111111111}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.2777777777777778, (2, 1): 0.6111111111111112, (2, 2): 0.1111111111111111}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 15.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=22.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.09090909090909091, (0, 1): 0.6818181818181818, (0, 2): 0.22727272727272727}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.09090909090909091, (0, 1): 0.6818181818181818, (0, 2): 0.22727272727272727}
in decode_message(signal=0) Receiver 5 got option: (0, 0) and decoded action: 0
Receiver 5 received signals: [0] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 5.0 -> 5.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 0): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 28.0}
in get_filtered_urn(filter=1) --- total: total=30.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.03333333333333333, (1, 1): 0.03333333333333333, (1, 2): 0.9333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.03333333333333333, (1, 1): 0.03333333333333333, (1, 2): 0.9333333333333333}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 28.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=30.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.03333333333333333, (2, 1): 0.9333333333333333, (2, 2): 0.03333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.03333333333333333, (2, 1): 0.9333333333333333, (2, 2): 0.03333333333333333}
in decode_message(signal=2) Receiver 2 got option: (2, 0) and decoded action: 0
Receiver 2 received signals: [2] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (1, 2): 28.0 -> 28.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 0): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 7.0, (0, 2): 12.0}
in get_filtered_urn(filter=0) --- total: total=21.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.09523809523809523, (0, 1): 0.3333333333333333, (0, 2): 0.5714285714285714}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.09523809523809523, (0, 1): 0.3333333333333333, (0, 2): 0.5714285714285714}
Sender 4 got filter 0 choose option: (0, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 15.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=22.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.09090909090909091, (0, 1): 0.6818181818181818, (0, 2): 0.22727272727272727}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.09090909090909091, (0, 1): 0.6818181818181818, (0, 2): 0.22727272727272727}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 0): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 15.0 -> 15.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 23.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=25.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.04, (0, 1): 0.92, (0, 2): 0.04}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.04, (0, 1): 0.92, (0, 2): 0.04}
Sender 1 got filter 0 choose option: (0, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 28.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=30.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.03333333333333333, (2, 1): 0.9333333333333333, (2, 2): 0.03333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.03333333333333333, (2, 1): 0.9333333333333333, (2, 2): 0.03333333333333333}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 2): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 1): 28.0 -> 28.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 11.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=18.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.2777777777777778, (2, 1): 0.6111111111111112, (2, 2): 0.1111111111111111}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.2777777777777778, (2, 1): 0.6111111111111112, (2, 2): 0.1111111111111111}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 7.0, (1, 1): 2.0, (1, 2): 11.0}
in get_filtered_urn(filter=1) --- total: total=20.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.35, (1, 1): 0.1, (1, 2): 0.55}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.35, (1, 1): 0.1, (1, 2): 0.55}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 11.0 -> 12.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 11.0 -> 12.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 28.0}
in get_filtered_urn(filter=1) --- total: total=30.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.03333333333333333, (1, 1): 0.03333333333333333, (1, 2): 0.9333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.03333333333333333, (1, 1): 0.03333333333333333, (1, 2): 0.9333333333333333}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 28.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=30.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.03333333333333333, (2, 1): 0.9333333333333333, (2, 2): 0.03333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.03333333333333333, (2, 1): 0.9333333333333333, (2, 2): 0.03333333333333333}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 28.0 -> 29.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 28.0 -> 29.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 12.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=19.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.2631578947368421, (2, 1): 0.631578947368421, (2, 2): 0.10526315789473684}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.2631578947368421, (2, 1): 0.631578947368421, (2, 2): 0.10526315789473684}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 12.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=17.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.7058823529411765, (2, 1): 0.17647058823529413, (2, 2): 0.11764705882352941}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.7058823529411765, (2, 1): 0.17647058823529413, (2, 2): 0.11764705882352941}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 12.0 -> 12.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 23.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=25.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.04, (0, 1): 0.92, (0, 2): 0.04}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.04, (0, 1): 0.92, (0, 2): 0.04}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 23.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=28.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8214285714285714, (1, 1): 0.03571428571428571, (1, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8214285714285714, (1, 1): 0.03571428571428571, (1, 2): 0.14285714285714285}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 23.0 -> 24.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 23.0 -> 24.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 12.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=19.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.2631578947368421, (2, 1): 0.631578947368421, (2, 2): 0.10526315789473684}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.2631578947368421, (2, 1): 0.631578947368421, (2, 2): 0.10526315789473684}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 7.0, (1, 1): 2.0, (1, 2): 12.0}
in get_filtered_urn(filter=1) --- total: total=21.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3333333333333333, (1, 1): 0.09523809523809523, (1, 2): 0.5714285714285714}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.3333333333333333, (1, 1): 0.09523809523809523, (1, 2): 0.5714285714285714}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 12.0 -> 12.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 7.0 -> 7.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 24.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=26.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.038461538461538464, (0, 1): 0.9230769230769231, (0, 2): 0.038461538461538464}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.038461538461538464, (0, 1): 0.9230769230769231, (0, 2): 0.038461538461538464}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 24.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=29.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8275862068965517, (1, 1): 0.034482758620689655, (1, 2): 0.13793103448275862}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8275862068965517, (1, 1): 0.034482758620689655, (1, 2): 0.13793103448275862}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 24.0 -> 25.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 24.0 -> 25.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 7.0, (0, 2): 12.0}
in get_filtered_urn(filter=0) --- total: total=21.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.09523809523809523, (0, 1): 0.3333333333333333, (0, 2): 0.5714285714285714}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.09523809523809523, (0, 1): 0.3333333333333333, (0, 2): 0.5714285714285714}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 12.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=17.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.7058823529411765, (2, 1): 0.17647058823529413, (2, 2): 0.11764705882352941}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.7058823529411765, (2, 1): 0.17647058823529413, (2, 2): 0.11764705882352941}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 12.0 -> 13.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 12.0 -> 13.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 29.0}
in get_filtered_urn(filter=1) --- total: total=31.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.03225806451612903, (1, 1): 0.03225806451612903, (1, 2): 0.9354838709677419}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.03225806451612903, (1, 1): 0.03225806451612903, (1, 2): 0.9354838709677419}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 29.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=31.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.03225806451612903, (2, 1): 0.9354838709677419, (2, 2): 0.03225806451612903}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.03225806451612903, (2, 1): 0.9354838709677419, (2, 2): 0.03225806451612903}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 29.0 -> 30.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 29.0 -> 30.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 7.0, (0, 2): 13.0}
in get_filtered_urn(filter=0) --- total: total=22.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.09090909090909091, (0, 1): 0.3181818181818182, (0, 2): 0.5909090909090909}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.09090909090909091, (0, 1): 0.3181818181818182, (0, 2): 0.5909090909090909}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 13.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=18.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.7222222222222222, (2, 1): 0.16666666666666666, (2, 2): 0.1111111111111111}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.7222222222222222, (2, 1): 0.16666666666666666, (2, 2): 0.1111111111111111}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 13.0 -> 14.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 13.0 -> 14.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 14.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=19.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.7368421052631579, (2, 1): 0.21052631578947367, (2, 2): 0.05263157894736842}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.7368421052631579, (2, 1): 0.21052631578947367, (2, 2): 0.05263157894736842}
Sender 1 got filter 2 choose option: (2, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 30.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=32.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.03125, (2, 1): 0.9375, (2, 2): 0.03125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.03125, (2, 1): 0.9375, (2, 2): 0.03125}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 2): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 1): 30.0 -> 30.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 7.0, (0, 2): 14.0}
in get_filtered_urn(filter=0) --- total: total=23.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.08695652173913043, (0, 1): 0.30434782608695654, (0, 2): 0.6086956521739131}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.08695652173913043, (0, 1): 0.30434782608695654, (0, 2): 0.6086956521739131}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 14.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=19.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.7368421052631579, (2, 1): 0.15789473684210525, (2, 2): 0.10526315789473684}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.7368421052631579, (2, 1): 0.15789473684210525, (2, 2): 0.10526315789473684}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 14.0 -> 15.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 14.0 -> 15.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 14.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=19.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.7368421052631579, (2, 1): 0.21052631578947367, (2, 2): 0.05263157894736842}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.7368421052631579, (2, 1): 0.21052631578947367, (2, 2): 0.05263157894736842}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 14.0}
in get_filtered_urn(filter=0) --- total: total=16.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0625, (0, 1): 0.0625, (0, 2): 0.875}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0625, (0, 1): 0.0625, (0, 2): 0.875}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 14.0 -> 15.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 14.0 -> 15.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 15.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=20.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.75, (1, 1): 0.1, (1, 2): 0.15}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.75, (1, 1): 0.1, (1, 2): 0.15}
Sender 4 got filter 1 choose option: (1, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 7.0, (1, 1): 2.0, (1, 2): 12.0}
in get_filtered_urn(filter=1) --- total: total=21.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3333333333333333, (1, 1): 0.09523809523809523, (1, 2): 0.5714285714285714}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.3333333333333333, (1, 1): 0.09523809523809523, (1, 2): 0.5714285714285714}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 1): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 12.0 -> 12.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 30.0}
in get_filtered_urn(filter=1) --- total: total=32.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.03125, (1, 1): 0.03125, (1, 2): 0.9375}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.03125, (1, 1): 0.03125, (1, 2): 0.9375}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 30.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=32.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.03125, (2, 1): 0.9375, (2, 2): 0.03125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.03125, (2, 1): 0.9375, (2, 2): 0.03125}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 30.0 -> 31.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 30.0 -> 31.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 15.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=20.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.75, (1, 1): 0.1, (1, 2): 0.15}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.75, (1, 1): 0.1, (1, 2): 0.15}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 15.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=22.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.09090909090909091, (0, 1): 0.6818181818181818, (0, 2): 0.22727272727272727}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.09090909090909091, (0, 1): 0.6818181818181818, (0, 2): 0.22727272727272727}
in decode_message(signal=0) Receiver 5 got option: (0, 0) and decoded action: 0
Receiver 5 received signals: [0] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 15.0 -> 15.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 0): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 25.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=27.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.037037037037037035, (0, 1): 0.9259259259259259, (0, 2): 0.037037037037037035}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.037037037037037035, (0, 1): 0.9259259259259259, (0, 2): 0.037037037037037035}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 25.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=30.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8333333333333334, (1, 1): 0.03333333333333333, (1, 2): 0.13333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8333333333333334, (1, 1): 0.03333333333333333, (1, 2): 0.13333333333333333}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 25.0 -> 26.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 25.0 -> 26.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 12.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=19.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.2631578947368421, (2, 1): 0.631578947368421, (2, 2): 0.10526315789473684}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.2631578947368421, (2, 1): 0.631578947368421, (2, 2): 0.10526315789473684}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 7.0, (1, 1): 2.0, (1, 2): 12.0}
in get_filtered_urn(filter=1) --- total: total=21.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3333333333333333, (1, 1): 0.09523809523809523, (1, 2): 0.5714285714285714}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.3333333333333333, (1, 1): 0.09523809523809523, (1, 2): 0.5714285714285714}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 12.0 -> 12.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 7.0 -> 7.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 26.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=28.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03571428571428571, (0, 1): 0.9285714285714286, (0, 2): 0.03571428571428571}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.03571428571428571, (0, 1): 0.9285714285714286, (0, 2): 0.03571428571428571}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 26.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=31.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8387096774193549, (1, 1): 0.03225806451612903, (1, 2): 0.12903225806451613}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8387096774193549, (1, 1): 0.03225806451612903, (1, 2): 0.12903225806451613}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 26.0 -> 27.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 26.0 -> 27.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 7.0, (0, 2): 15.0}
in get_filtered_urn(filter=0) --- total: total=24.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.08333333333333333, (0, 1): 0.2916666666666667, (0, 2): 0.625}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.08333333333333333, (0, 1): 0.2916666666666667, (0, 2): 0.625}
Sender 4 got filter 0 choose option: (0, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 15.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=22.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.09090909090909091, (0, 1): 0.6818181818181818, (0, 2): 0.22727272727272727}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.09090909090909091, (0, 1): 0.6818181818181818, (0, 2): 0.22727272727272727}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 0): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 5.0 -> 5.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 31.0}
in get_filtered_urn(filter=1) --- total: total=33.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.030303030303030304, (1, 1): 0.030303030303030304, (1, 2): 0.9393939393939394}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.030303030303030304, (1, 1): 0.030303030303030304, (1, 2): 0.9393939393939394}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 31.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=33.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.030303030303030304, (2, 1): 0.9393939393939394, (2, 2): 0.030303030303030304}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.030303030303030304, (2, 1): 0.9393939393939394, (2, 2): 0.030303030303030304}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 31.0 -> 32.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 31.0 -> 32.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 7.0, (0, 2): 15.0}
in get_filtered_urn(filter=0) --- total: total=24.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.08333333333333333, (0, 1): 0.2916666666666667, (0, 2): 0.625}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.08333333333333333, (0, 1): 0.2916666666666667, (0, 2): 0.625}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 15.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=20.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.75, (2, 1): 0.15, (2, 2): 0.1}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.75, (2, 1): 0.15, (2, 2): 0.1}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 15.0 -> 16.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 15.0 -> 16.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 27.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=29.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.034482758620689655, (0, 1): 0.9310344827586207, (0, 2): 0.034482758620689655}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.034482758620689655, (0, 1): 0.9310344827586207, (0, 2): 0.034482758620689655}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 27.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=32.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.84375, (1, 1): 0.03125, (1, 2): 0.125}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.84375, (1, 1): 0.03125, (1, 2): 0.125}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 27.0 -> 28.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 27.0 -> 28.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 15.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=20.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.75, (1, 1): 0.1, (1, 2): 0.15}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.75, (1, 1): 0.1, (1, 2): 0.15}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 15.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=22.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.09090909090909091, (0, 1): 0.6818181818181818, (0, 2): 0.22727272727272727}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.09090909090909091, (0, 1): 0.6818181818181818, (0, 2): 0.22727272727272727}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 15.0 -> 15.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 5.0 -> 5.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 32.0}
in get_filtered_urn(filter=1) --- total: total=34.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.029411764705882353, (1, 1): 0.029411764705882353, (1, 2): 0.9411764705882353}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.029411764705882353, (1, 1): 0.029411764705882353, (1, 2): 0.9411764705882353}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 32.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=34.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.029411764705882353, (2, 1): 0.9411764705882353, (2, 2): 0.029411764705882353}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.029411764705882353, (2, 1): 0.9411764705882353, (2, 2): 0.029411764705882353}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 32.0 -> 33.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 32.0 -> 33.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 12.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=19.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.2631578947368421, (2, 1): 0.631578947368421, (2, 2): 0.10526315789473684}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.2631578947368421, (2, 1): 0.631578947368421, (2, 2): 0.10526315789473684}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 7.0, (1, 1): 2.0, (1, 2): 12.0}
in get_filtered_urn(filter=1) --- total: total=21.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3333333333333333, (1, 1): 0.09523809523809523, (1, 2): 0.5714285714285714}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.3333333333333333, (1, 1): 0.09523809523809523, (1, 2): 0.5714285714285714}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 12.0 -> 13.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 12.0 -> 13.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 33.0}
in get_filtered_urn(filter=1) --- total: total=35.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.02857142857142857, (1, 1): 0.02857142857142857, (1, 2): 0.9428571428571428}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.02857142857142857, (1, 1): 0.02857142857142857, (1, 2): 0.9428571428571428}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 33.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=35.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.02857142857142857, (2, 1): 0.9428571428571428, (2, 2): 0.02857142857142857}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.02857142857142857, (2, 1): 0.9428571428571428, (2, 2): 0.02857142857142857}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 33.0 -> 34.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 33.0 -> 34.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 13.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=20.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.25, (2, 1): 0.65, (2, 2): 0.1}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.25, (2, 1): 0.65, (2, 2): 0.1}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 15.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=22.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.09090909090909091, (0, 1): 0.6818181818181818, (0, 2): 0.22727272727272727}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.09090909090909091, (0, 1): 0.6818181818181818, (0, 2): 0.22727272727272727}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 5.0 -> 5.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 15.0 -> 15.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 34.0}
in get_filtered_urn(filter=1) --- total: total=36.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.027777777777777776, (1, 1): 0.027777777777777776, (1, 2): 0.9444444444444444}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.027777777777777776, (1, 1): 0.027777777777777776, (1, 2): 0.9444444444444444}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 34.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=36.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.027777777777777776, (2, 1): 0.9444444444444444, (2, 2): 0.027777777777777776}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.027777777777777776, (2, 1): 0.9444444444444444, (2, 2): 0.027777777777777776}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 34.0 -> 35.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 34.0 -> 35.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 15.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=20.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.75, (1, 1): 0.1, (1, 2): 0.15}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.75, (1, 1): 0.1, (1, 2): 0.15}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 15.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=22.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.09090909090909091, (0, 1): 0.6818181818181818, (0, 2): 0.22727272727272727}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.09090909090909091, (0, 1): 0.6818181818181818, (0, 2): 0.22727272727272727}
in decode_message(signal=0) Receiver 5 got option: (0, 0) and decoded action: 0
Receiver 5 received signals: [0] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 15.0 -> 15.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 0): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 35.0}
in get_filtered_urn(filter=1) --- total: total=37.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.02702702702702703, (1, 1): 0.02702702702702703, (1, 2): 0.9459459459459459}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.02702702702702703, (1, 1): 0.02702702702702703, (1, 2): 0.9459459459459459}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 35.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=37.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.02702702702702703, (2, 1): 0.9459459459459459, (2, 2): 0.02702702702702703}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.02702702702702703, (2, 1): 0.9459459459459459, (2, 2): 0.02702702702702703}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 35.0 -> 36.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 35.0 -> 36.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 7.0, (0, 2): 16.0}
in get_filtered_urn(filter=0) --- total: total=25.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.08, (0, 1): 0.28, (0, 2): 0.64}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.08, (0, 1): 0.28, (0, 2): 0.64}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 16.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=21.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.7619047619047619, (2, 1): 0.14285714285714285, (2, 2): 0.09523809523809523}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.7619047619047619, (2, 1): 0.14285714285714285, (2, 2): 0.09523809523809523}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 16.0 -> 17.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 16.0 -> 17.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 36.0}
in get_filtered_urn(filter=1) --- total: total=38.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.02631578947368421, (1, 1): 0.02631578947368421, (1, 2): 0.9473684210526315}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.02631578947368421, (1, 1): 0.02631578947368421, (1, 2): 0.9473684210526315}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 36.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=38.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.02631578947368421, (2, 1): 0.9473684210526315, (2, 2): 0.02631578947368421}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.02631578947368421, (2, 1): 0.9473684210526315, (2, 2): 0.02631578947368421}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 36.0 -> 37.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 36.0 -> 37.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 15.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=20.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.75, (1, 1): 0.1, (1, 2): 0.15}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.75, (1, 1): 0.1, (1, 2): 0.15}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 15.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=22.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.09090909090909091, (0, 1): 0.6818181818181818, (0, 2): 0.22727272727272727}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.09090909090909091, (0, 1): 0.6818181818181818, (0, 2): 0.22727272727272727}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 15.0 -> 16.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 15.0 -> 16.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 37.0}
in get_filtered_urn(filter=1) --- total: total=39.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.02564102564102564, (1, 1): 0.02564102564102564, (1, 2): 0.9487179487179487}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.02564102564102564, (1, 1): 0.02564102564102564, (1, 2): 0.9487179487179487}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 37.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=39.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.02564102564102564, (2, 1): 0.9487179487179487, (2, 2): 0.02564102564102564}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.02564102564102564, (2, 1): 0.9487179487179487, (2, 2): 0.02564102564102564}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 37.0 -> 38.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 37.0 -> 38.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 7.0, (0, 2): 17.0}
in get_filtered_urn(filter=0) --- total: total=26.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.07692307692307693, (0, 1): 0.2692307692307692, (0, 2): 0.6538461538461539}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.07692307692307693, (0, 1): 0.2692307692307692, (0, 2): 0.6538461538461539}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 17.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=22.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.7727272727272727, (2, 1): 0.13636363636363635, (2, 2): 0.09090909090909091}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.7727272727272727, (2, 1): 0.13636363636363635, (2, 2): 0.09090909090909091}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 17.0 -> 18.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 17.0 -> 18.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 28.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=30.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03333333333333333, (0, 1): 0.9333333333333333, (0, 2): 0.03333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.03333333333333333, (0, 1): 0.9333333333333333, (0, 2): 0.03333333333333333}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 28.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=33.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8484848484848485, (1, 1): 0.030303030303030304, (1, 2): 0.12121212121212122}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8484848484848485, (1, 1): 0.030303030303030304, (1, 2): 0.12121212121212122}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 28.0 -> 29.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 28.0 -> 29.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 13.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=20.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.25, (2, 1): 0.65, (2, 2): 0.1}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.25, (2, 1): 0.65, (2, 2): 0.1}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 7.0, (1, 1): 2.0, (1, 2): 13.0}
in get_filtered_urn(filter=1) --- total: total=22.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3181818181818182, (1, 1): 0.09090909090909091, (1, 2): 0.5909090909090909}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.3181818181818182, (1, 1): 0.09090909090909091, (1, 2): 0.5909090909090909}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 13.0 -> 13.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 7.0 -> 7.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 15.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=20.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.75, (2, 1): 0.2, (2, 2): 0.05}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.75, (2, 1): 0.2, (2, 2): 0.05}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 15.0}
in get_filtered_urn(filter=0) --- total: total=17.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.058823529411764705, (0, 1): 0.058823529411764705, (0, 2): 0.8823529411764706}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.058823529411764705, (0, 1): 0.058823529411764705, (0, 2): 0.8823529411764706}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 15.0 -> 16.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 15.0 -> 16.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 16.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=21.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7619047619047619, (1, 1): 0.09523809523809523, (1, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7619047619047619, (1, 1): 0.09523809523809523, (1, 2): 0.14285714285714285}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 16.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=23.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.08695652173913043, (0, 1): 0.6956521739130435, (0, 2): 0.21739130434782608}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.08695652173913043, (0, 1): 0.6956521739130435, (0, 2): 0.21739130434782608}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 16.0 -> 16.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 5.0 -> 5.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 29.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=31.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03225806451612903, (0, 1): 0.9354838709677419, (0, 2): 0.03225806451612903}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.03225806451612903, (0, 1): 0.9354838709677419, (0, 2): 0.03225806451612903}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 29.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=34.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8529411764705882, (1, 1): 0.029411764705882353, (1, 2): 0.11764705882352941}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8529411764705882, (1, 1): 0.029411764705882353, (1, 2): 0.11764705882352941}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 29.0 -> 30.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 29.0 -> 30.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 16.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=21.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7619047619047619, (1, 1): 0.09523809523809523, (1, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7619047619047619, (1, 1): 0.09523809523809523, (1, 2): 0.14285714285714285}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 16.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=23.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.08695652173913043, (0, 1): 0.6956521739130435, (0, 2): 0.21739130434782608}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.08695652173913043, (0, 1): 0.6956521739130435, (0, 2): 0.21739130434782608}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 16.0 -> 16.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 5.0 -> 5.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 38.0}
in get_filtered_urn(filter=1) --- total: total=40.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.025, (1, 1): 0.025, (1, 2): 0.95}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.025, (1, 1): 0.025, (1, 2): 0.95}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 38.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=40.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.025, (2, 1): 0.95, (2, 2): 0.025}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.025, (2, 1): 0.95, (2, 2): 0.025}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 38.0 -> 39.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 38.0 -> 39.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 16.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=21.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7619047619047619, (1, 1): 0.09523809523809523, (1, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7619047619047619, (1, 1): 0.09523809523809523, (1, 2): 0.14285714285714285}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 16.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=23.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.08695652173913043, (0, 1): 0.6956521739130435, (0, 2): 0.21739130434782608}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.08695652173913043, (0, 1): 0.6956521739130435, (0, 2): 0.21739130434782608}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 16.0 -> 16.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 5.0 -> 5.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 39.0}
in get_filtered_urn(filter=1) --- total: total=41.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.024390243902439025, (1, 1): 0.024390243902439025, (1, 2): 0.9512195121951219}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.024390243902439025, (1, 1): 0.024390243902439025, (1, 2): 0.9512195121951219}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 39.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=41.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.024390243902439025, (2, 1): 0.9512195121951219, (2, 2): 0.024390243902439025}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.024390243902439025, (2, 1): 0.9512195121951219, (2, 2): 0.024390243902439025}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 39.0 -> 40.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 39.0 -> 40.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 7.0, (0, 2): 18.0}
in get_filtered_urn(filter=0) --- total: total=27.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.07407407407407407, (0, 1): 0.25925925925925924, (0, 2): 0.6666666666666666}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.07407407407407407, (0, 1): 0.25925925925925924, (0, 2): 0.6666666666666666}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 18.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=23.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.782608695652174, (2, 1): 0.13043478260869565, (2, 2): 0.08695652173913043}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.782608695652174, (2, 1): 0.13043478260869565, (2, 2): 0.08695652173913043}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 18.0 -> 19.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 18.0 -> 19.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 30.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=32.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03125, (0, 1): 0.9375, (0, 2): 0.03125}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.03125, (0, 1): 0.9375, (0, 2): 0.03125}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 30.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=35.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8571428571428571, (1, 1): 0.02857142857142857, (1, 2): 0.11428571428571428}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8571428571428571, (1, 1): 0.02857142857142857, (1, 2): 0.11428571428571428}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 30.0 -> 31.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 30.0 -> 31.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 13.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=20.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.25, (2, 1): 0.65, (2, 2): 0.1}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.25, (2, 1): 0.65, (2, 2): 0.1}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 7.0, (1, 1): 2.0, (1, 2): 13.0}
in get_filtered_urn(filter=1) --- total: total=22.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3181818181818182, (1, 1): 0.09090909090909091, (1, 2): 0.5909090909090909}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.3181818181818182, (1, 1): 0.09090909090909091, (1, 2): 0.5909090909090909}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 13.0 -> 14.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 13.0 -> 14.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 16.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=21.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.7619047619047619, (2, 1): 0.19047619047619047, (2, 2): 0.047619047619047616}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.7619047619047619, (2, 1): 0.19047619047619047, (2, 2): 0.047619047619047616}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 16.0}
in get_filtered_urn(filter=0) --- total: total=18.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05555555555555555, (0, 1): 0.05555555555555555, (0, 2): 0.8888888888888888}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.05555555555555555, (0, 1): 0.05555555555555555, (0, 2): 0.8888888888888888}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 16.0 -> 17.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 16.0 -> 17.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 7.0, (0, 2): 19.0}
in get_filtered_urn(filter=0) --- total: total=28.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.07142857142857142, (0, 1): 0.25, (0, 2): 0.6785714285714286}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.07142857142857142, (0, 1): 0.25, (0, 2): 0.6785714285714286}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 19.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=24.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.7916666666666666, (2, 1): 0.125, (2, 2): 0.08333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.7916666666666666, (2, 1): 0.125, (2, 2): 0.08333333333333333}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 19.0 -> 20.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 19.0 -> 20.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 17.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=22.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.7727272727272727, (2, 1): 0.18181818181818182, (2, 2): 0.045454545454545456}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.7727272727272727, (2, 1): 0.18181818181818182, (2, 2): 0.045454545454545456}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 17.0}
in get_filtered_urn(filter=0) --- total: total=19.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05263157894736842, (0, 1): 0.05263157894736842, (0, 2): 0.8947368421052632}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.05263157894736842, (0, 1): 0.05263157894736842, (0, 2): 0.8947368421052632}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 17.0 -> 18.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 17.0 -> 18.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 16.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=21.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7619047619047619, (1, 1): 0.09523809523809523, (1, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.7619047619047619, (1, 1): 0.09523809523809523, (1, 2): 0.14285714285714285}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 20.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=25.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8, (2, 1): 0.12, (2, 2): 0.08}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8, (2, 1): 0.12, (2, 2): 0.08}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 3.0 -> 3.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 20.0 -> 20.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 40.0}
in get_filtered_urn(filter=1) --- total: total=42.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.023809523809523808, (1, 1): 0.023809523809523808, (1, 2): 0.9523809523809523}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.023809523809523808, (1, 1): 0.023809523809523808, (1, 2): 0.9523809523809523}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 40.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=42.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.023809523809523808, (2, 1): 0.9523809523809523, (2, 2): 0.023809523809523808}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.023809523809523808, (2, 1): 0.9523809523809523, (2, 2): 0.023809523809523808}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 40.0 -> 41.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 40.0 -> 41.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 7.0, (0, 2): 20.0}
in get_filtered_urn(filter=0) --- total: total=29.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.06896551724137931, (0, 1): 0.2413793103448276, (0, 2): 0.6896551724137931}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.06896551724137931, (0, 1): 0.2413793103448276, (0, 2): 0.6896551724137931}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 7.0, (1, 1): 2.0, (1, 2): 14.0}
in get_filtered_urn(filter=1) --- total: total=23.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.30434782608695654, (1, 1): 0.08695652173913043, (1, 2): 0.6086956521739131}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.30434782608695654, (1, 1): 0.08695652173913043, (1, 2): 0.6086956521739131}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 7.0 -> 7.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 14.0 -> 14.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 41.0}
in get_filtered_urn(filter=1) --- total: total=43.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.023255813953488372, (1, 1): 0.023255813953488372, (1, 2): 0.9534883720930233}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.023255813953488372, (1, 1): 0.023255813953488372, (1, 2): 0.9534883720930233}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 41.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=43.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.023255813953488372, (2, 1): 0.9534883720930233, (2, 2): 0.023255813953488372}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.023255813953488372, (2, 1): 0.9534883720930233, (2, 2): 0.023255813953488372}
in decode_message(signal=2) Receiver 2 got option: (2, 2) and decoded action: 2
Receiver 2 received signals: [2] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (1, 2): 41.0 -> 41.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 2): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 14.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=21.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.23809523809523808, (2, 1): 0.6666666666666666, (2, 2): 0.09523809523809523}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.23809523809523808, (2, 1): 0.6666666666666666, (2, 2): 0.09523809523809523}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 16.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=23.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.08695652173913043, (0, 1): 0.6956521739130435, (0, 2): 0.21739130434782608}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.08695652173913043, (0, 1): 0.6956521739130435, (0, 2): 0.21739130434782608}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 5.0 -> 5.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 16.0 -> 16.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 41.0}
in get_filtered_urn(filter=1) --- total: total=43.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.023255813953488372, (1, 1): 0.023255813953488372, (1, 2): 0.9534883720930233}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.023255813953488372, (1, 1): 0.023255813953488372, (1, 2): 0.9534883720930233}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 41.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=43.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.023255813953488372, (2, 1): 0.9534883720930233, (2, 2): 0.023255813953488372}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.023255813953488372, (2, 1): 0.9534883720930233, (2, 2): 0.023255813953488372}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 41.0 -> 42.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 41.0 -> 42.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 7.0, (0, 2): 20.0}
in get_filtered_urn(filter=0) --- total: total=29.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.06896551724137931, (0, 1): 0.2413793103448276, (0, 2): 0.6896551724137931}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.06896551724137931, (0, 1): 0.2413793103448276, (0, 2): 0.6896551724137931}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 7.0, (1, 1): 2.0, (1, 2): 14.0}
in get_filtered_urn(filter=1) --- total: total=23.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.30434782608695654, (1, 1): 0.08695652173913043, (1, 2): 0.6086956521739131}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.30434782608695654, (1, 1): 0.08695652173913043, (1, 2): 0.6086956521739131}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 1): 7.0 -> 8.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 0): 7.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 31.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=33.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.030303030303030304, (0, 1): 0.9393939393939394, (0, 2): 0.030303030303030304}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.030303030303030304, (0, 1): 0.9393939393939394, (0, 2): 0.030303030303030304}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 31.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=36.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8611111111111112, (1, 1): 0.027777777777777776, (1, 2): 0.1111111111111111}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8611111111111112, (1, 1): 0.027777777777777776, (1, 2): 0.1111111111111111}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 31.0 -> 32.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 31.0 -> 32.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 16.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=21.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7619047619047619, (1, 1): 0.09523809523809523, (1, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7619047619047619, (1, 1): 0.09523809523809523, (1, 2): 0.14285714285714285}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 16.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=23.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.08695652173913043, (0, 1): 0.6956521739130435, (0, 2): 0.21739130434782608}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.08695652173913043, (0, 1): 0.6956521739130435, (0, 2): 0.21739130434782608}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 16.0 -> 16.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 5.0 -> 5.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 18.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=23.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.782608695652174, (2, 1): 0.17391304347826086, (2, 2): 0.043478260869565216}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.782608695652174, (2, 1): 0.17391304347826086, (2, 2): 0.043478260869565216}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 18.0}
in get_filtered_urn(filter=0) --- total: total=20.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05, (0, 1): 0.05, (0, 2): 0.9}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.05, (0, 1): 0.05, (0, 2): 0.9}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 18.0 -> 19.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 18.0 -> 19.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 14.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=21.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.23809523809523808, (2, 1): 0.6666666666666666, (2, 2): 0.09523809523809523}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.23809523809523808, (2, 1): 0.6666666666666666, (2, 2): 0.09523809523809523}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 20.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=25.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8, (2, 1): 0.12, (2, 2): 0.08}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8, (2, 1): 0.12, (2, 2): 0.08}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 20.0 -> 20.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 42.0}
in get_filtered_urn(filter=1) --- total: total=44.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.022727272727272728, (1, 1): 0.022727272727272728, (1, 2): 0.9545454545454546}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.022727272727272728, (1, 1): 0.022727272727272728, (1, 2): 0.9545454545454546}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 42.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=44.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.022727272727272728, (2, 1): 0.9545454545454546, (2, 2): 0.022727272727272728}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.022727272727272728, (2, 1): 0.9545454545454546, (2, 2): 0.022727272727272728}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 42.0 -> 43.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 42.0 -> 43.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 20.0}
in get_filtered_urn(filter=0) --- total: total=30.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.06666666666666667, (0, 1): 0.26666666666666666, (0, 2): 0.6666666666666666}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.06666666666666667, (0, 1): 0.26666666666666666, (0, 2): 0.6666666666666666}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 20.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=25.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8, (2, 1): 0.12, (2, 2): 0.08}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8, (2, 1): 0.12, (2, 2): 0.08}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 20.0 -> 21.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 20.0 -> 21.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 19.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=24.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.7916666666666666, (2, 1): 0.16666666666666666, (2, 2): 0.041666666666666664}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.7916666666666666, (2, 1): 0.16666666666666666, (2, 2): 0.041666666666666664}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 19.0}
in get_filtered_urn(filter=0) --- total: total=21.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.047619047619047616, (0, 1): 0.047619047619047616, (0, 2): 0.9047619047619048}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.047619047619047616, (0, 1): 0.047619047619047616, (0, 2): 0.9047619047619048}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 19.0 -> 20.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 19.0 -> 20.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 16.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=21.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7619047619047619, (1, 1): 0.09523809523809523, (1, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7619047619047619, (1, 1): 0.09523809523809523, (1, 2): 0.14285714285714285}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 16.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=23.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.08695652173913043, (0, 1): 0.6956521739130435, (0, 2): 0.21739130434782608}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.08695652173913043, (0, 1): 0.6956521739130435, (0, 2): 0.21739130434782608}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 16.0 -> 17.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 16.0 -> 17.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 32.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=34.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.029411764705882353, (0, 1): 0.9411764705882353, (0, 2): 0.029411764705882353}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.029411764705882353, (0, 1): 0.9411764705882353, (0, 2): 0.029411764705882353}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 32.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=37.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8648648648648649, (1, 1): 0.02702702702702703, (1, 2): 0.10810810810810811}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8648648648648649, (1, 1): 0.02702702702702703, (1, 2): 0.10810810810810811}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 32.0 -> 33.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 32.0 -> 33.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 14.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=21.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.23809523809523808, (2, 1): 0.6666666666666666, (2, 2): 0.09523809523809523}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.23809523809523808, (2, 1): 0.6666666666666666, (2, 2): 0.09523809523809523}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 21.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=26.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8076923076923077, (2, 1): 0.11538461538461539, (2, 2): 0.07692307692307693}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8076923076923077, (2, 1): 0.11538461538461539, (2, 2): 0.07692307692307693}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 21.0 -> 21.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 20.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=25.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8, (2, 1): 0.16, (2, 2): 0.04}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8, (2, 1): 0.16, (2, 2): 0.04}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 20.0}
in get_filtered_urn(filter=0) --- total: total=22.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.045454545454545456, (0, 1): 0.045454545454545456, (0, 2): 0.9090909090909091}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.045454545454545456, (0, 1): 0.045454545454545456, (0, 2): 0.9090909090909091}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 20.0 -> 21.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 20.0 -> 21.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 17.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=22.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7727272727272727, (1, 1): 0.09090909090909091, (1, 2): 0.13636363636363635}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7727272727272727, (1, 1): 0.09090909090909091, (1, 2): 0.13636363636363635}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 17.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=24.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.08333333333333333, (0, 1): 0.7083333333333334, (0, 2): 0.20833333333333334}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.08333333333333333, (0, 1): 0.7083333333333334, (0, 2): 0.20833333333333334}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 17.0 -> 17.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 5.0 -> 5.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 43.0}
in get_filtered_urn(filter=1) --- total: total=45.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.022222222222222223, (1, 1): 0.022222222222222223, (1, 2): 0.9555555555555556}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.022222222222222223, (1, 1): 0.022222222222222223, (1, 2): 0.9555555555555556}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 43.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=45.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.022222222222222223, (2, 1): 0.9555555555555556, (2, 2): 0.022222222222222223}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.022222222222222223, (2, 1): 0.9555555555555556, (2, 2): 0.022222222222222223}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 43.0 -> 44.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 43.0 -> 44.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 21.0}
in get_filtered_urn(filter=0) --- total: total=31.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.06451612903225806, (0, 1): 0.25806451612903225, (0, 2): 0.6774193548387096}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.06451612903225806, (0, 1): 0.25806451612903225, (0, 2): 0.6774193548387096}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 21.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=26.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8076923076923077, (2, 1): 0.11538461538461539, (2, 2): 0.07692307692307693}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8076923076923077, (2, 1): 0.11538461538461539, (2, 2): 0.07692307692307693}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 21.0 -> 22.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 21.0 -> 22.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 21.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=26.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8076923076923077, (2, 1): 0.15384615384615385, (2, 2): 0.038461538461538464}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8076923076923077, (2, 1): 0.15384615384615385, (2, 2): 0.038461538461538464}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 21.0}
in get_filtered_urn(filter=0) --- total: total=23.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.043478260869565216, (0, 1): 0.043478260869565216, (0, 2): 0.9130434782608695}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.043478260869565216, (0, 1): 0.043478260869565216, (0, 2): 0.9130434782608695}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 21.0 -> 22.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 21.0 -> 22.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 17.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=22.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7727272727272727, (1, 1): 0.09090909090909091, (1, 2): 0.13636363636363635}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7727272727272727, (1, 1): 0.09090909090909091, (1, 2): 0.13636363636363635}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 17.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=24.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.08333333333333333, (0, 1): 0.7083333333333334, (0, 2): 0.20833333333333334}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.08333333333333333, (0, 1): 0.7083333333333334, (0, 2): 0.20833333333333334}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 17.0 -> 17.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 5.0 -> 5.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 33.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=35.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02857142857142857, (0, 1): 0.9428571428571428, (0, 2): 0.02857142857142857}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.02857142857142857, (0, 1): 0.9428571428571428, (0, 2): 0.02857142857142857}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 33.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=38.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.868421052631579, (1, 1): 0.02631578947368421, (1, 2): 0.10526315789473684}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.868421052631579, (1, 1): 0.02631578947368421, (1, 2): 0.10526315789473684}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 33.0 -> 34.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 33.0 -> 34.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 17.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=22.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7727272727272727, (1, 1): 0.09090909090909091, (1, 2): 0.13636363636363635}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.7727272727272727, (1, 1): 0.09090909090909091, (1, 2): 0.13636363636363635}
Sender 4 got filter 1 choose option: (1, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 8.0, (1, 1): 2.0, (1, 2): 14.0}
in get_filtered_urn(filter=1) --- total: total=24.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3333333333333333, (1, 1): 0.08333333333333333, (1, 2): 0.5833333333333334}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.3333333333333333, (1, 1): 0.08333333333333333, (1, 2): 0.5833333333333334}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 1): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 14.0 -> 14.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 22.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=27.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8148148148148148, (2, 1): 0.14814814814814814, (2, 2): 0.037037037037037035}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8148148148148148, (2, 1): 0.14814814814814814, (2, 2): 0.037037037037037035}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 22.0}
in get_filtered_urn(filter=0) --- total: total=24.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.041666666666666664, (0, 1): 0.041666666666666664, (0, 2): 0.9166666666666666}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.041666666666666664, (0, 1): 0.041666666666666664, (0, 2): 0.9166666666666666}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 22.0 -> 23.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 22.0 -> 23.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 14.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=21.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.23809523809523808, (2, 1): 0.6666666666666666, (2, 2): 0.09523809523809523}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.23809523809523808, (2, 1): 0.6666666666666666, (2, 2): 0.09523809523809523}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 8.0, (1, 1): 2.0, (1, 2): 14.0}
in get_filtered_urn(filter=1) --- total: total=24.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3333333333333333, (1, 1): 0.08333333333333333, (1, 2): 0.5833333333333334}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.3333333333333333, (1, 1): 0.08333333333333333, (1, 2): 0.5833333333333334}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 14.0 -> 15.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 14.0 -> 15.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 23.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=28.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8214285714285714, (2, 1): 0.14285714285714285, (2, 2): 0.03571428571428571}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8214285714285714, (2, 1): 0.14285714285714285, (2, 2): 0.03571428571428571}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 23.0}
in get_filtered_urn(filter=0) --- total: total=25.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.04, (0, 1): 0.04, (0, 2): 0.92}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.04, (0, 1): 0.04, (0, 2): 0.92}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 23.0 -> 24.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 23.0 -> 24.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 22.0}
in get_filtered_urn(filter=0) --- total: total=32.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0625, (0, 1): 0.25, (0, 2): 0.6875}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0625, (0, 1): 0.25, (0, 2): 0.6875}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 8.0, (1, 1): 2.0, (1, 2): 15.0}
in get_filtered_urn(filter=1) --- total: total=25.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.32, (1, 1): 0.08, (1, 2): 0.6}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.32, (1, 1): 0.08, (1, 2): 0.6}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 8.0 -> 8.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 15.0 -> 15.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 24.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=29.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8275862068965517, (2, 1): 0.13793103448275862, (2, 2): 0.034482758620689655}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8275862068965517, (2, 1): 0.13793103448275862, (2, 2): 0.034482758620689655}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 24.0}
in get_filtered_urn(filter=0) --- total: total=26.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.038461538461538464, (0, 1): 0.038461538461538464, (0, 2): 0.9230769230769231}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.038461538461538464, (0, 1): 0.038461538461538464, (0, 2): 0.9230769230769231}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 24.0 -> 25.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 24.0 -> 25.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 17.0, (1, 1): 2.0, (1, 2): 3.0}
in get_filtered_urn(filter=1) --- total: total=22.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7727272727272727, (1, 1): 0.09090909090909091, (1, 2): 0.13636363636363635}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.7727272727272727, (1, 1): 0.09090909090909091, (1, 2): 0.13636363636363635}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 22.0, (2, 1): 3.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=27.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8148148148148148, (2, 1): 0.1111111111111111, (2, 2): 0.07407407407407407}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.8148148148148148, (2, 1): 0.1111111111111111, (2, 2): 0.07407407407407407}
in decode_message(signal=2) Receiver 5 got option: (2, 1) and decoded action: 1
Receiver 5 received signals: [2] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 2): 3.0 -> 4.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 1): 3.0 -> 4.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 44.0}
in get_filtered_urn(filter=1) --- total: total=46.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.021739130434782608, (1, 1): 0.021739130434782608, (1, 2): 0.9565217391304348}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.021739130434782608, (1, 1): 0.021739130434782608, (1, 2): 0.9565217391304348}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 44.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=46.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.021739130434782608, (2, 1): 0.9565217391304348, (2, 2): 0.021739130434782608}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.021739130434782608, (2, 1): 0.9565217391304348, (2, 2): 0.021739130434782608}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 44.0 -> 45.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 44.0 -> 45.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 22.0}
in get_filtered_urn(filter=0) --- total: total=32.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0625, (0, 1): 0.25, (0, 2): 0.6875}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0625, (0, 1): 0.25, (0, 2): 0.6875}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 22.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=28.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.7857142857142857, (2, 1): 0.14285714285714285, (2, 2): 0.07142857142857142}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.7857142857142857, (2, 1): 0.14285714285714285, (2, 2): 0.07142857142857142}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 22.0 -> 23.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 22.0 -> 23.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 45.0}
in get_filtered_urn(filter=1) --- total: total=47.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.02127659574468085, (1, 1): 0.02127659574468085, (1, 2): 0.9574468085106383}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.02127659574468085, (1, 1): 0.02127659574468085, (1, 2): 0.9574468085106383}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 45.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=47.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.02127659574468085, (2, 1): 0.9574468085106383, (2, 2): 0.02127659574468085}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.02127659574468085, (2, 1): 0.9574468085106383, (2, 2): 0.02127659574468085}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 45.0 -> 46.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 45.0 -> 46.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 17.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=23.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7391304347826086, (1, 1): 0.08695652173913043, (1, 2): 0.17391304347826086}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7391304347826086, (1, 1): 0.08695652173913043, (1, 2): 0.17391304347826086}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 17.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=24.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.08333333333333333, (0, 1): 0.7083333333333334, (0, 2): 0.20833333333333334}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.08333333333333333, (0, 1): 0.7083333333333334, (0, 2): 0.20833333333333334}
in decode_message(signal=0) Receiver 5 got option: (0, 0) and decoded action: 0
Receiver 5 received signals: [0] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 17.0 -> 17.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 0): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 46.0}
in get_filtered_urn(filter=1) --- total: total=48.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.020833333333333332, (1, 1): 0.020833333333333332, (1, 2): 0.9583333333333334}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.020833333333333332, (1, 1): 0.020833333333333332, (1, 2): 0.9583333333333334}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 46.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=48.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.020833333333333332, (2, 1): 0.9583333333333334, (2, 2): 0.020833333333333332}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.020833333333333332, (2, 1): 0.9583333333333334, (2, 2): 0.020833333333333332}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 46.0 -> 47.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 46.0 -> 47.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 23.0}
in get_filtered_urn(filter=0) --- total: total=33.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.06060606060606061, (0, 1): 0.24242424242424243, (0, 2): 0.696969696969697}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.06060606060606061, (0, 1): 0.24242424242424243, (0, 2): 0.696969696969697}
Sender 4 got filter 0 choose option: (0, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 17.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=24.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.08333333333333333, (0, 1): 0.7083333333333334, (0, 2): 0.20833333333333334}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.08333333333333333, (0, 1): 0.7083333333333334, (0, 2): 0.20833333333333334}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 0): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 17.0 -> 17.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 25.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=30.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8333333333333334, (2, 1): 0.13333333333333333, (2, 2): 0.03333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8333333333333334, (2, 1): 0.13333333333333333, (2, 2): 0.03333333333333333}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 25.0}
in get_filtered_urn(filter=0) --- total: total=27.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.037037037037037035, (0, 1): 0.037037037037037035, (0, 2): 0.9259259259259259}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.037037037037037035, (0, 1): 0.037037037037037035, (0, 2): 0.9259259259259259}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 25.0 -> 26.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 25.0 -> 26.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 15.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=22.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.22727272727272727, (2, 1): 0.6818181818181818, (2, 2): 0.09090909090909091}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.22727272727272727, (2, 1): 0.6818181818181818, (2, 2): 0.09090909090909091}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 17.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=24.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.08333333333333333, (0, 1): 0.7083333333333334, (0, 2): 0.20833333333333334}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.08333333333333333, (0, 1): 0.7083333333333334, (0, 2): 0.20833333333333334}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 5.0 -> 5.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 17.0 -> 17.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 34.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=36.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.027777777777777776, (0, 1): 0.9444444444444444, (0, 2): 0.027777777777777776}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.027777777777777776, (0, 1): 0.9444444444444444, (0, 2): 0.027777777777777776}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 34.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=39.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8717948717948718, (1, 1): 0.02564102564102564, (1, 2): 0.10256410256410256}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.8717948717948718, (1, 1): 0.02564102564102564, (1, 2): 0.10256410256410256}
in decode_message(signal=1) Receiver 2 got option: (1, 2) and decoded action: 2
Receiver 2 received signals: [1] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 1): 34.0 -> 34.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 23.0}
in get_filtered_urn(filter=0) --- total: total=33.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.06060606060606061, (0, 1): 0.24242424242424243, (0, 2): 0.696969696969697}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.06060606060606061, (0, 1): 0.24242424242424243, (0, 2): 0.696969696969697}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 23.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=29.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.7931034482758621, (2, 1): 0.13793103448275862, (2, 2): 0.06896551724137931}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.7931034482758621, (2, 1): 0.13793103448275862, (2, 2): 0.06896551724137931}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 23.0 -> 24.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 23.0 -> 24.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 34.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=36.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.027777777777777776, (0, 1): 0.9444444444444444, (0, 2): 0.027777777777777776}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.027777777777777776, (0, 1): 0.9444444444444444, (0, 2): 0.027777777777777776}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 34.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=39.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8717948717948718, (1, 1): 0.02564102564102564, (1, 2): 0.10256410256410256}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8717948717948718, (1, 1): 0.02564102564102564, (1, 2): 0.10256410256410256}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 34.0 -> 35.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 34.0 -> 35.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 17.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=23.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7391304347826086, (1, 1): 0.08695652173913043, (1, 2): 0.17391304347826086}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7391304347826086, (1, 1): 0.08695652173913043, (1, 2): 0.17391304347826086}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 17.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=24.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.08333333333333333, (0, 1): 0.7083333333333334, (0, 2): 0.20833333333333334}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.08333333333333333, (0, 1): 0.7083333333333334, (0, 2): 0.20833333333333334}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 17.0 -> 18.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 17.0 -> 18.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 47.0}
in get_filtered_urn(filter=1) --- total: total=49.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.02040816326530612, (1, 1): 0.02040816326530612, (1, 2): 0.9591836734693877}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.02040816326530612, (1, 1): 0.02040816326530612, (1, 2): 0.9591836734693877}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 47.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=49.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.02040816326530612, (2, 1): 0.9591836734693877, (2, 2): 0.02040816326530612}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.02040816326530612, (2, 1): 0.9591836734693877, (2, 2): 0.02040816326530612}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 47.0 -> 48.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 47.0 -> 48.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 15.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=22.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.22727272727272727, (2, 1): 0.6818181818181818, (2, 2): 0.09090909090909091}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.22727272727272727, (2, 1): 0.6818181818181818, (2, 2): 0.09090909090909091}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 8.0, (1, 1): 2.0, (1, 2): 15.0}
in get_filtered_urn(filter=1) --- total: total=25.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.32, (1, 1): 0.08, (1, 2): 0.6}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.32, (1, 1): 0.08, (1, 2): 0.6}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 15.0 -> 15.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 8.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 26.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=31.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8387096774193549, (2, 1): 0.12903225806451613, (2, 2): 0.03225806451612903}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8387096774193549, (2, 1): 0.12903225806451613, (2, 2): 0.03225806451612903}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 26.0}
in get_filtered_urn(filter=0) --- total: total=28.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03571428571428571, (0, 1): 0.03571428571428571, (0, 2): 0.9285714285714286}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.03571428571428571, (0, 1): 0.03571428571428571, (0, 2): 0.9285714285714286}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 26.0 -> 27.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 26.0 -> 27.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 15.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=22.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.22727272727272727, (2, 1): 0.6818181818181818, (2, 2): 0.09090909090909091}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.22727272727272727, (2, 1): 0.6818181818181818, (2, 2): 0.09090909090909091}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 8.0, (1, 1): 2.0, (1, 2): 15.0}
in get_filtered_urn(filter=1) --- total: total=25.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.32, (1, 1): 0.08, (1, 2): 0.6}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.32, (1, 1): 0.08, (1, 2): 0.6}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 15.0 -> 15.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 8.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 35.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=37.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02702702702702703, (0, 1): 0.9459459459459459, (0, 2): 0.02702702702702703}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.02702702702702703, (0, 1): 0.9459459459459459, (0, 2): 0.02702702702702703}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 35.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=40.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.875, (1, 1): 0.025, (1, 2): 0.1}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.875, (1, 1): 0.025, (1, 2): 0.1}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 35.0 -> 36.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 35.0 -> 36.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 18.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=24.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.75, (1, 1): 0.08333333333333333, (1, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.75, (1, 1): 0.08333333333333333, (1, 2): 0.16666666666666666}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 24.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=30.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8, (2, 1): 0.13333333333333333, (2, 2): 0.06666666666666667}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8, (2, 1): 0.13333333333333333, (2, 2): 0.06666666666666667}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 24.0 -> 24.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 48.0}
in get_filtered_urn(filter=1) --- total: total=50.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.02, (1, 1): 0.02, (1, 2): 0.96}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.02, (1, 1): 0.02, (1, 2): 0.96}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 48.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=50.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.02, (2, 1): 0.96, (2, 2): 0.02}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.02, (2, 1): 0.96, (2, 2): 0.02}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 48.0 -> 49.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 48.0 -> 49.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 18.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=24.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.75, (1, 1): 0.08333333333333333, (1, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.75, (1, 1): 0.08333333333333333, (1, 2): 0.16666666666666666}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 18.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=25.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.08, (0, 1): 0.72, (0, 2): 0.2}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.08, (0, 1): 0.72, (0, 2): 0.2}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 18.0 -> 19.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 18.0 -> 19.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 27.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=32.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.84375, (2, 1): 0.125, (2, 2): 0.03125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.84375, (2, 1): 0.125, (2, 2): 0.03125}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 27.0}
in get_filtered_urn(filter=0) --- total: total=29.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.034482758620689655, (0, 1): 0.034482758620689655, (0, 2): 0.9310344827586207}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.034482758620689655, (0, 1): 0.034482758620689655, (0, 2): 0.9310344827586207}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 27.0 -> 28.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 27.0 -> 28.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 24.0}
in get_filtered_urn(filter=0) --- total: total=34.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.058823529411764705, (0, 1): 0.23529411764705882, (0, 2): 0.7058823529411765}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.058823529411764705, (0, 1): 0.23529411764705882, (0, 2): 0.7058823529411765}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 8.0, (1, 1): 2.0, (1, 2): 15.0}
in get_filtered_urn(filter=1) --- total: total=25.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.32, (1, 1): 0.08, (1, 2): 0.6}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.32, (1, 1): 0.08, (1, 2): 0.6}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 8.0 -> 8.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 15.0 -> 15.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 36.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=38.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02631578947368421, (0, 1): 0.9473684210526315, (0, 2): 0.02631578947368421}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.02631578947368421, (0, 1): 0.9473684210526315, (0, 2): 0.02631578947368421}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 36.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=41.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8780487804878049, (1, 1): 0.024390243902439025, (1, 2): 0.0975609756097561}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8780487804878049, (1, 1): 0.024390243902439025, (1, 2): 0.0975609756097561}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 36.0 -> 37.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 36.0 -> 37.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 19.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=25.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.76, (1, 1): 0.08, (1, 2): 0.16}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.76, (1, 1): 0.08, (1, 2): 0.16}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 19.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=26.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.07692307692307693, (0, 1): 0.7307692307692307, (0, 2): 0.19230769230769232}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.07692307692307693, (0, 1): 0.7307692307692307, (0, 2): 0.19230769230769232}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 19.0 -> 19.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 5.0 -> 5.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 37.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=39.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02564102564102564, (0, 1): 0.9487179487179487, (0, 2): 0.02564102564102564}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.02564102564102564, (0, 1): 0.9487179487179487, (0, 2): 0.02564102564102564}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 37.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=42.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8809523809523809, (1, 1): 0.023809523809523808, (1, 2): 0.09523809523809523}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8809523809523809, (1, 1): 0.023809523809523808, (1, 2): 0.09523809523809523}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 37.0 -> 38.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 37.0 -> 38.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 19.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=25.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.76, (1, 1): 0.08, (1, 2): 0.16}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.76, (1, 1): 0.08, (1, 2): 0.16}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 19.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=26.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.07692307692307693, (0, 1): 0.7307692307692307, (0, 2): 0.19230769230769232}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.07692307692307693, (0, 1): 0.7307692307692307, (0, 2): 0.19230769230769232}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 19.0 -> 19.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 5.0 -> 5.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 28.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=33.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8484848484848485, (2, 1): 0.12121212121212122, (2, 2): 0.030303030303030304}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.8484848484848485, (2, 1): 0.12121212121212122, (2, 2): 0.030303030303030304}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 38.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=43.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8837209302325582, (1, 1): 0.023255813953488372, (1, 2): 0.09302325581395349}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8837209302325582, (1, 1): 0.023255813953488372, (1, 2): 0.09302325581395349}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 1): 4.0 -> 4.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 0): 38.0 -> 38.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 24.0}
in get_filtered_urn(filter=0) --- total: total=34.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.058823529411764705, (0, 1): 0.23529411764705882, (0, 2): 0.7058823529411765}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.058823529411764705, (0, 1): 0.23529411764705882, (0, 2): 0.7058823529411765}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 24.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=30.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8, (2, 1): 0.13333333333333333, (2, 2): 0.06666666666666667}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8, (2, 1): 0.13333333333333333, (2, 2): 0.06666666666666667}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 24.0 -> 25.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 24.0 -> 25.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 49.0}
in get_filtered_urn(filter=1) --- total: total=51.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0196078431372549, (1, 1): 0.0196078431372549, (1, 2): 0.9607843137254902}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0196078431372549, (1, 1): 0.0196078431372549, (1, 2): 0.9607843137254902}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 49.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=51.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0196078431372549, (2, 1): 0.9607843137254902, (2, 2): 0.0196078431372549}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0196078431372549, (2, 1): 0.9607843137254902, (2, 2): 0.0196078431372549}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 49.0 -> 50.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 49.0 -> 50.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 25.0}
in get_filtered_urn(filter=0) --- total: total=35.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05714285714285714, (0, 1): 0.22857142857142856, (0, 2): 0.7142857142857143}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.05714285714285714, (0, 1): 0.22857142857142856, (0, 2): 0.7142857142857143}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 25.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=31.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8064516129032258, (2, 1): 0.12903225806451613, (2, 2): 0.06451612903225806}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8064516129032258, (2, 1): 0.12903225806451613, (2, 2): 0.06451612903225806}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 25.0 -> 26.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 25.0 -> 26.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 28.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=33.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8484848484848485, (2, 1): 0.12121212121212122, (2, 2): 0.030303030303030304}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8484848484848485, (2, 1): 0.12121212121212122, (2, 2): 0.030303030303030304}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 28.0}
in get_filtered_urn(filter=0) --- total: total=30.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03333333333333333, (0, 1): 0.03333333333333333, (0, 2): 0.9333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.03333333333333333, (0, 1): 0.03333333333333333, (0, 2): 0.9333333333333333}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 28.0 -> 29.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 28.0 -> 29.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 19.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=25.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.76, (1, 1): 0.08, (1, 2): 0.16}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.76, (1, 1): 0.08, (1, 2): 0.16}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 19.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=26.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.07692307692307693, (0, 1): 0.7307692307692307, (0, 2): 0.19230769230769232}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.07692307692307693, (0, 1): 0.7307692307692307, (0, 2): 0.19230769230769232}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 19.0 -> 20.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 19.0 -> 20.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 29.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=34.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8529411764705882, (2, 1): 0.11764705882352941, (2, 2): 0.029411764705882353}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8529411764705882, (2, 1): 0.11764705882352941, (2, 2): 0.029411764705882353}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 29.0}
in get_filtered_urn(filter=0) --- total: total=31.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03225806451612903, (0, 1): 0.03225806451612903, (0, 2): 0.9354838709677419}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.03225806451612903, (0, 1): 0.03225806451612903, (0, 2): 0.9354838709677419}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 29.0 -> 30.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 29.0 -> 30.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 26.0}
in get_filtered_urn(filter=0) --- total: total=36.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05555555555555555, (0, 1): 0.2222222222222222, (0, 2): 0.7222222222222222}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.05555555555555555, (0, 1): 0.2222222222222222, (0, 2): 0.7222222222222222}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 8.0, (1, 1): 2.0, (1, 2): 15.0}
in get_filtered_urn(filter=1) --- total: total=25.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.32, (1, 1): 0.08, (1, 2): 0.6}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.32, (1, 1): 0.08, (1, 2): 0.6}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 8.0 -> 8.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 15.0 -> 15.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 50.0}
in get_filtered_urn(filter=1) --- total: total=52.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.019230769230769232, (1, 1): 0.019230769230769232, (1, 2): 0.9615384615384616}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.019230769230769232, (1, 1): 0.019230769230769232, (1, 2): 0.9615384615384616}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 50.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=52.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.019230769230769232, (2, 1): 0.9615384615384616, (2, 2): 0.019230769230769232}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.019230769230769232, (2, 1): 0.9615384615384616, (2, 2): 0.019230769230769232}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 50.0 -> 51.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 50.0 -> 51.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 26.0}
in get_filtered_urn(filter=0) --- total: total=36.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05555555555555555, (0, 1): 0.2222222222222222, (0, 2): 0.7222222222222222}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.05555555555555555, (0, 1): 0.2222222222222222, (0, 2): 0.7222222222222222}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 26.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=32.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8125, (2, 1): 0.125, (2, 2): 0.0625}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8125, (2, 1): 0.125, (2, 2): 0.0625}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 26.0 -> 27.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 26.0 -> 27.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 30.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=35.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8571428571428571, (2, 1): 0.11428571428571428, (2, 2): 0.02857142857142857}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8571428571428571, (2, 1): 0.11428571428571428, (2, 2): 0.02857142857142857}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 30.0}
in get_filtered_urn(filter=0) --- total: total=32.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03125, (0, 1): 0.03125, (0, 2): 0.9375}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.03125, (0, 1): 0.03125, (0, 2): 0.9375}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 30.0 -> 31.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 30.0 -> 31.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 20.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=26.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7692307692307693, (1, 1): 0.07692307692307693, (1, 2): 0.15384615384615385}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7692307692307693, (1, 1): 0.07692307692307693, (1, 2): 0.15384615384615385}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 20.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=27.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.07407407407407407, (0, 1): 0.7407407407407407, (0, 2): 0.18518518518518517}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.07407407407407407, (0, 1): 0.7407407407407407, (0, 2): 0.18518518518518517}
in decode_message(signal=0) Receiver 5 got option: (0, 0) and decoded action: 0
Receiver 5 received signals: [0] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 20.0 -> 20.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 0): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 51.0}
in get_filtered_urn(filter=1) --- total: total=53.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.018867924528301886, (1, 1): 0.018867924528301886, (1, 2): 0.9622641509433962}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.018867924528301886, (1, 1): 0.018867924528301886, (1, 2): 0.9622641509433962}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 51.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=53.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.018867924528301886, (2, 1): 0.9622641509433962, (2, 2): 0.018867924528301886}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.018867924528301886, (2, 1): 0.9622641509433962, (2, 2): 0.018867924528301886}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 51.0 -> 52.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 51.0 -> 52.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 15.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=22.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.22727272727272727, (2, 1): 0.6818181818181818, (2, 2): 0.09090909090909091}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.22727272727272727, (2, 1): 0.6818181818181818, (2, 2): 0.09090909090909091}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 8.0, (1, 1): 2.0, (1, 2): 15.0}
in get_filtered_urn(filter=1) --- total: total=25.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.32, (1, 1): 0.08, (1, 2): 0.6}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.32, (1, 1): 0.08, (1, 2): 0.6}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 15.0 -> 16.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 15.0 -> 16.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 38.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=40.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.025, (0, 1): 0.95, (0, 2): 0.025}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.025, (0, 1): 0.95, (0, 2): 0.025}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 38.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=43.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8837209302325582, (1, 1): 0.023255813953488372, (1, 2): 0.09302325581395349}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8837209302325582, (1, 1): 0.023255813953488372, (1, 2): 0.09302325581395349}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 38.0 -> 39.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 38.0 -> 39.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 5.0, (2, 1): 16.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=23.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.21739130434782608, (2, 1): 0.6956521739130435, (2, 2): 0.08695652173913043}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.21739130434782608, (2, 1): 0.6956521739130435, (2, 2): 0.08695652173913043}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 20.0, (0, 2): 5.0}
in get_filtered_urn(filter=0) --- total: total=27.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.07407407407407407, (0, 1): 0.7407407407407407, (0, 2): 0.18518518518518517}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.07407407407407407, (0, 1): 0.7407407407407407, (0, 2): 0.18518518518518517}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 0): 5.0 -> 6.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 2): 5.0 -> 6.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 52.0}
in get_filtered_urn(filter=1) --- total: total=54.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.018518518518518517, (1, 1): 0.018518518518518517, (1, 2): 0.9629629629629629}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.018518518518518517, (1, 1): 0.018518518518518517, (1, 2): 0.9629629629629629}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 52.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=54.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.018518518518518517, (2, 1): 0.9629629629629629, (2, 2): 0.018518518518518517}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.018518518518518517, (2, 1): 0.9629629629629629, (2, 2): 0.018518518518518517}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 52.0 -> 53.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 52.0 -> 53.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 20.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=26.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7692307692307693, (1, 1): 0.07692307692307693, (1, 2): 0.15384615384615385}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7692307692307693, (1, 1): 0.07692307692307693, (1, 2): 0.15384615384615385}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 20.0, (0, 2): 6.0}
in get_filtered_urn(filter=0) --- total: total=28.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.07142857142857142, (0, 1): 0.7142857142857143, (0, 2): 0.21428571428571427}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.07142857142857142, (0, 1): 0.7142857142857143, (0, 2): 0.21428571428571427}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 20.0 -> 20.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 6.0 -> 6.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 53.0}
in get_filtered_urn(filter=1) --- total: total=55.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.01818181818181818, (1, 1): 0.01818181818181818, (1, 2): 0.9636363636363636}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.01818181818181818, (1, 1): 0.01818181818181818, (1, 2): 0.9636363636363636}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 53.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=55.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.01818181818181818, (2, 1): 0.9636363636363636, (2, 2): 0.01818181818181818}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.01818181818181818, (2, 1): 0.9636363636363636, (2, 2): 0.01818181818181818}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 53.0 -> 54.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 53.0 -> 54.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 27.0}
in get_filtered_urn(filter=0) --- total: total=37.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05405405405405406, (0, 1): 0.21621621621621623, (0, 2): 0.7297297297297297}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.05405405405405406, (0, 1): 0.21621621621621623, (0, 2): 0.7297297297297297}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 27.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=33.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8181818181818182, (2, 1): 0.12121212121212122, (2, 2): 0.06060606060606061}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8181818181818182, (2, 1): 0.12121212121212122, (2, 2): 0.06060606060606061}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 27.0 -> 28.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 27.0 -> 28.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 31.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=36.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8611111111111112, (2, 1): 0.1111111111111111, (2, 2): 0.027777777777777776}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8611111111111112, (2, 1): 0.1111111111111111, (2, 2): 0.027777777777777776}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 31.0}
in get_filtered_urn(filter=0) --- total: total=33.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.030303030303030304, (0, 1): 0.030303030303030304, (0, 2): 0.9393939393939394}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.030303030303030304, (0, 1): 0.030303030303030304, (0, 2): 0.9393939393939394}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 31.0 -> 32.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 31.0 -> 32.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 20.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=26.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7692307692307693, (1, 1): 0.07692307692307693, (1, 2): 0.15384615384615385}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7692307692307693, (1, 1): 0.07692307692307693, (1, 2): 0.15384615384615385}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 20.0, (0, 2): 6.0}
in get_filtered_urn(filter=0) --- total: total=28.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.07142857142857142, (0, 1): 0.7142857142857143, (0, 2): 0.21428571428571427}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.07142857142857142, (0, 1): 0.7142857142857143, (0, 2): 0.21428571428571427}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 20.0 -> 21.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 20.0 -> 21.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 32.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=37.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8648648648648649, (2, 1): 0.10810810810810811, (2, 2): 0.02702702702702703}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8648648648648649, (2, 1): 0.10810810810810811, (2, 2): 0.02702702702702703}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 32.0}
in get_filtered_urn(filter=0) --- total: total=34.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.029411764705882353, (0, 1): 0.029411764705882353, (0, 2): 0.9411764705882353}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.029411764705882353, (0, 1): 0.029411764705882353, (0, 2): 0.9411764705882353}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 32.0 -> 33.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 32.0 -> 33.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 6.0, (2, 1): 16.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=24.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.25, (2, 1): 0.6666666666666666, (2, 2): 0.08333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.25, (2, 1): 0.6666666666666666, (2, 2): 0.08333333333333333}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 8.0, (1, 1): 2.0, (1, 2): 16.0}
in get_filtered_urn(filter=1) --- total: total=26.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3076923076923077, (1, 1): 0.07692307692307693, (1, 2): 0.6153846153846154}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.3076923076923077, (1, 1): 0.07692307692307693, (1, 2): 0.6153846153846154}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 16.0 -> 16.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 8.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 33.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=38.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.868421052631579, (2, 1): 0.10526315789473684, (2, 2): 0.02631578947368421}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.868421052631579, (2, 1): 0.10526315789473684, (2, 2): 0.02631578947368421}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 33.0}
in get_filtered_urn(filter=0) --- total: total=35.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02857142857142857, (0, 1): 0.02857142857142857, (0, 2): 0.9428571428571428}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02857142857142857, (0, 1): 0.02857142857142857, (0, 2): 0.9428571428571428}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 33.0 -> 34.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 33.0 -> 34.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 28.0}
in get_filtered_urn(filter=0) --- total: total=38.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05263157894736842, (0, 1): 0.21052631578947367, (0, 2): 0.7368421052631579}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.05263157894736842, (0, 1): 0.21052631578947367, (0, 2): 0.7368421052631579}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 28.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=34.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8235294117647058, (2, 1): 0.11764705882352941, (2, 2): 0.058823529411764705}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8235294117647058, (2, 1): 0.11764705882352941, (2, 2): 0.058823529411764705}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 28.0 -> 29.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 28.0 -> 29.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 39.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=41.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.024390243902439025, (0, 1): 0.9512195121951219, (0, 2): 0.024390243902439025}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.024390243902439025, (0, 1): 0.9512195121951219, (0, 2): 0.024390243902439025}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 39.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=44.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8863636363636364, (1, 1): 0.022727272727272728, (1, 2): 0.09090909090909091}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8863636363636364, (1, 1): 0.022727272727272728, (1, 2): 0.09090909090909091}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 39.0 -> 40.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 39.0 -> 40.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 6.0, (2, 1): 16.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=24.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.25, (2, 1): 0.6666666666666666, (2, 2): 0.08333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.25, (2, 1): 0.6666666666666666, (2, 2): 0.08333333333333333}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 8.0, (1, 1): 2.0, (1, 2): 16.0}
in get_filtered_urn(filter=1) --- total: total=26.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3076923076923077, (1, 1): 0.07692307692307693, (1, 2): 0.6153846153846154}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.3076923076923077, (1, 1): 0.07692307692307693, (1, 2): 0.6153846153846154}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 16.0 -> 17.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 16.0 -> 17.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 54.0}
in get_filtered_urn(filter=1) --- total: total=56.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.017857142857142856, (1, 1): 0.017857142857142856, (1, 2): 0.9642857142857143}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.017857142857142856, (1, 1): 0.017857142857142856, (1, 2): 0.9642857142857143}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 54.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=56.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.017857142857142856, (2, 1): 0.9642857142857143, (2, 2): 0.017857142857142856}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.017857142857142856, (2, 1): 0.9642857142857143, (2, 2): 0.017857142857142856}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 54.0 -> 55.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 54.0 -> 55.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 21.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=27.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7777777777777778, (1, 1): 0.07407407407407407, (1, 2): 0.14814814814814814}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7777777777777778, (1, 1): 0.07407407407407407, (1, 2): 0.14814814814814814}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 21.0, (0, 2): 6.0}
in get_filtered_urn(filter=0) --- total: total=29.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.06896551724137931, (0, 1): 0.7241379310344828, (0, 2): 0.20689655172413793}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.06896551724137931, (0, 1): 0.7241379310344828, (0, 2): 0.20689655172413793}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 21.0 -> 22.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 21.0 -> 22.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 40.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=42.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.023809523809523808, (0, 1): 0.9523809523809523, (0, 2): 0.023809523809523808}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.023809523809523808, (0, 1): 0.9523809523809523, (0, 2): 0.023809523809523808}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 40.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=45.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8888888888888888, (1, 1): 0.022222222222222223, (1, 2): 0.08888888888888889}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8888888888888888, (1, 1): 0.022222222222222223, (1, 2): 0.08888888888888889}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 40.0 -> 41.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 40.0 -> 41.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 29.0}
in get_filtered_urn(filter=0) --- total: total=39.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05128205128205128, (0, 1): 0.20512820512820512, (0, 2): 0.7435897435897436}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.05128205128205128, (0, 1): 0.20512820512820512, (0, 2): 0.7435897435897436}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 8.0, (1, 1): 2.0, (1, 2): 17.0}
in get_filtered_urn(filter=1) --- total: total=27.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.2962962962962963, (1, 1): 0.07407407407407407, (1, 2): 0.6296296296296297}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.2962962962962963, (1, 1): 0.07407407407407407, (1, 2): 0.6296296296296297}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 8.0 -> 8.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 17.0 -> 17.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 34.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=39.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8717948717948718, (2, 1): 0.10256410256410256, (2, 2): 0.02564102564102564}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8717948717948718, (2, 1): 0.10256410256410256, (2, 2): 0.02564102564102564}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 34.0}
in get_filtered_urn(filter=0) --- total: total=36.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.027777777777777776, (0, 1): 0.027777777777777776, (0, 2): 0.9444444444444444}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.027777777777777776, (0, 1): 0.027777777777777776, (0, 2): 0.9444444444444444}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 34.0 -> 35.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 34.0 -> 35.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 29.0}
in get_filtered_urn(filter=0) --- total: total=39.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05128205128205128, (0, 1): 0.20512820512820512, (0, 2): 0.7435897435897436}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.05128205128205128, (0, 1): 0.20512820512820512, (0, 2): 0.7435897435897436}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 29.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=35.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8285714285714286, (2, 1): 0.11428571428571428, (2, 2): 0.05714285714285714}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8285714285714286, (2, 1): 0.11428571428571428, (2, 2): 0.05714285714285714}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 29.0 -> 30.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 29.0 -> 30.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 35.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=40.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.875, (2, 1): 0.1, (2, 2): 0.025}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.875, (2, 1): 0.1, (2, 2): 0.025}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 35.0}
in get_filtered_urn(filter=0) --- total: total=37.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02702702702702703, (0, 1): 0.02702702702702703, (0, 2): 0.9459459459459459}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02702702702702703, (0, 1): 0.02702702702702703, (0, 2): 0.9459459459459459}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 35.0 -> 36.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 35.0 -> 36.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 22.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=28.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7857142857142857, (1, 1): 0.07142857142857142, (1, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7857142857142857, (1, 1): 0.07142857142857142, (1, 2): 0.14285714285714285}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 22.0, (0, 2): 6.0}
in get_filtered_urn(filter=0) --- total: total=30.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.06666666666666667, (0, 1): 0.7333333333333333, (0, 2): 0.2}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.06666666666666667, (0, 1): 0.7333333333333333, (0, 2): 0.2}
in decode_message(signal=0) Receiver 5 got option: (0, 0) and decoded action: 0
Receiver 5 received signals: [0] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 22.0 -> 22.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 0): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 41.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=43.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.023255813953488372, (0, 1): 0.9534883720930233, (0, 2): 0.023255813953488372}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.023255813953488372, (0, 1): 0.9534883720930233, (0, 2): 0.023255813953488372}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 41.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=46.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8913043478260869, (1, 1): 0.021739130434782608, (1, 2): 0.08695652173913043}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8913043478260869, (1, 1): 0.021739130434782608, (1, 2): 0.08695652173913043}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 41.0 -> 42.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 41.0 -> 42.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 6.0, (2, 1): 17.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=25.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.24, (2, 1): 0.68, (2, 2): 0.08}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.24, (2, 1): 0.68, (2, 2): 0.08}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 30.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=36.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8333333333333334, (2, 1): 0.1111111111111111, (2, 2): 0.05555555555555555}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8333333333333334, (2, 1): 0.1111111111111111, (2, 2): 0.05555555555555555}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 30.0 -> 30.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 42.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=44.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.022727272727272728, (0, 1): 0.9545454545454546, (0, 2): 0.022727272727272728}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.022727272727272728, (0, 1): 0.9545454545454546, (0, 2): 0.022727272727272728}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 42.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=47.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8936170212765957, (1, 1): 0.02127659574468085, (1, 2): 0.0851063829787234}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8936170212765957, (1, 1): 0.02127659574468085, (1, 2): 0.0851063829787234}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 42.0 -> 43.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 42.0 -> 43.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 22.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=28.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7857142857142857, (1, 1): 0.07142857142857142, (1, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.7857142857142857, (1, 1): 0.07142857142857142, (1, 2): 0.14285714285714285}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 30.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=36.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8333333333333334, (2, 1): 0.1111111111111111, (2, 2): 0.05555555555555555}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8333333333333334, (2, 1): 0.1111111111111111, (2, 2): 0.05555555555555555}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 30.0 -> 30.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 55.0}
in get_filtered_urn(filter=1) --- total: total=57.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.017543859649122806, (1, 1): 0.017543859649122806, (1, 2): 0.9649122807017544}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.017543859649122806, (1, 1): 0.017543859649122806, (1, 2): 0.9649122807017544}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 55.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=57.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.017543859649122806, (2, 1): 0.9649122807017544, (2, 2): 0.017543859649122806}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.017543859649122806, (2, 1): 0.9649122807017544, (2, 2): 0.017543859649122806}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 55.0 -> 56.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 55.0 -> 56.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 6.0, (2, 1): 17.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=25.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.24, (2, 1): 0.68, (2, 2): 0.08}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.24, (2, 1): 0.68, (2, 2): 0.08}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 8.0, (1, 1): 2.0, (1, 2): 17.0}
in get_filtered_urn(filter=1) --- total: total=27.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.2962962962962963, (1, 1): 0.07407407407407407, (1, 2): 0.6296296296296297}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.2962962962962963, (1, 1): 0.07407407407407407, (1, 2): 0.6296296296296297}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 17.0 -> 17.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 8.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 56.0}
in get_filtered_urn(filter=1) --- total: total=58.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.017241379310344827, (1, 1): 0.017241379310344827, (1, 2): 0.9655172413793104}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.017241379310344827, (1, 1): 0.017241379310344827, (1, 2): 0.9655172413793104}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 56.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=58.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.017241379310344827, (2, 1): 0.9655172413793104, (2, 2): 0.017241379310344827}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.017241379310344827, (2, 1): 0.9655172413793104, (2, 2): 0.017241379310344827}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 56.0 -> 57.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 56.0 -> 57.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 30.0}
in get_filtered_urn(filter=0) --- total: total=40.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05, (0, 1): 0.2, (0, 2): 0.75}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.05, (0, 1): 0.2, (0, 2): 0.75}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 30.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=36.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8333333333333334, (2, 1): 0.1111111111111111, (2, 2): 0.05555555555555555}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.8333333333333334, (2, 1): 0.1111111111111111, (2, 2): 0.05555555555555555}
in decode_message(signal=2) Receiver 5 got option: (2, 1) and decoded action: 1
Receiver 5 received signals: [2] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 2): 30.0 -> 30.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 1): 4.0 -> 4.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 57.0}
in get_filtered_urn(filter=1) --- total: total=59.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.01694915254237288, (1, 1): 0.01694915254237288, (1, 2): 0.9661016949152542}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.01694915254237288, (1, 1): 0.01694915254237288, (1, 2): 0.9661016949152542}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 57.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=59.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.01694915254237288, (2, 1): 0.9661016949152542, (2, 2): 0.01694915254237288}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.01694915254237288, (2, 1): 0.9661016949152542, (2, 2): 0.01694915254237288}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 57.0 -> 58.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 57.0 -> 58.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 6.0, (2, 1): 17.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=25.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.24, (2, 1): 0.68, (2, 2): 0.08}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.24, (2, 1): 0.68, (2, 2): 0.08}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 22.0, (0, 2): 6.0}
in get_filtered_urn(filter=0) --- total: total=30.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.06666666666666667, (0, 1): 0.7333333333333333, (0, 2): 0.2}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.06666666666666667, (0, 1): 0.7333333333333333, (0, 2): 0.2}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 6.0 -> 6.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 22.0 -> 22.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 58.0}
in get_filtered_urn(filter=1) --- total: total=60.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.016666666666666666, (1, 1): 0.016666666666666666, (1, 2): 0.9666666666666667}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.016666666666666666, (1, 1): 0.016666666666666666, (1, 2): 0.9666666666666667}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 58.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=60.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.016666666666666666, (2, 1): 0.9666666666666667, (2, 2): 0.016666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.016666666666666666, (2, 1): 0.9666666666666667, (2, 2): 0.016666666666666666}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 58.0 -> 59.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 58.0 -> 59.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 30.0}
in get_filtered_urn(filter=0) --- total: total=40.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05, (0, 1): 0.2, (0, 2): 0.75}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.05, (0, 1): 0.2, (0, 2): 0.75}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 30.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=36.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8333333333333334, (2, 1): 0.1111111111111111, (2, 2): 0.05555555555555555}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8333333333333334, (2, 1): 0.1111111111111111, (2, 2): 0.05555555555555555}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 30.0 -> 31.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 30.0 -> 31.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 43.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=45.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.022222222222222223, (0, 1): 0.9555555555555556, (0, 2): 0.022222222222222223}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.022222222222222223, (0, 1): 0.9555555555555556, (0, 2): 0.022222222222222223}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 43.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=48.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8958333333333334, (1, 1): 0.020833333333333332, (1, 2): 0.08333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8958333333333334, (1, 1): 0.020833333333333332, (1, 2): 0.08333333333333333}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 43.0 -> 44.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 43.0 -> 44.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 31.0}
in get_filtered_urn(filter=0) --- total: total=41.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.04878048780487805, (0, 1): 0.1951219512195122, (0, 2): 0.7560975609756098}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.04878048780487805, (0, 1): 0.1951219512195122, (0, 2): 0.7560975609756098}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 8.0, (1, 1): 2.0, (1, 2): 17.0}
in get_filtered_urn(filter=1) --- total: total=27.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.2962962962962963, (1, 1): 0.07407407407407407, (1, 2): 0.6296296296296297}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.2962962962962963, (1, 1): 0.07407407407407407, (1, 2): 0.6296296296296297}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 8.0 -> 8.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 17.0 -> 17.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 44.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=46.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.021739130434782608, (0, 1): 0.9565217391304348, (0, 2): 0.021739130434782608}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.021739130434782608, (0, 1): 0.9565217391304348, (0, 2): 0.021739130434782608}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 44.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=49.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8979591836734694, (1, 1): 0.02040816326530612, (1, 2): 0.08163265306122448}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8979591836734694, (1, 1): 0.02040816326530612, (1, 2): 0.08163265306122448}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 44.0 -> 45.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 44.0 -> 45.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 8.0, (0, 2): 31.0}
in get_filtered_urn(filter=0) --- total: total=41.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.04878048780487805, (0, 1): 0.1951219512195122, (0, 2): 0.7560975609756098}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.04878048780487805, (0, 1): 0.1951219512195122, (0, 2): 0.7560975609756098}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 8.0, (1, 1): 2.0, (1, 2): 17.0}
in get_filtered_urn(filter=1) --- total: total=27.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.2962962962962963, (1, 1): 0.07407407407407407, (1, 2): 0.6296296296296297}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.2962962962962963, (1, 1): 0.07407407407407407, (1, 2): 0.6296296296296297}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 1): 8.0 -> 9.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 0): 8.0 -> 9.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 45.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=47.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02127659574468085, (0, 1): 0.9574468085106383, (0, 2): 0.02127659574468085}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.02127659574468085, (0, 1): 0.9574468085106383, (0, 2): 0.02127659574468085}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 45.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=50.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9, (1, 1): 0.02, (1, 2): 0.08}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9, (1, 1): 0.02, (1, 2): 0.08}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 45.0 -> 46.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 45.0 -> 46.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 6.0, (2, 1): 17.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=25.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.24, (2, 1): 0.68, (2, 2): 0.08}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.24, (2, 1): 0.68, (2, 2): 0.08}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 9.0, (1, 1): 2.0, (1, 2): 17.0}
in get_filtered_urn(filter=1) --- total: total=28.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.32142857142857145, (1, 1): 0.07142857142857142, (1, 2): 0.6071428571428571}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.32142857142857145, (1, 1): 0.07142857142857142, (1, 2): 0.6071428571428571}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 17.0 -> 17.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 9.0 -> 9.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 36.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=41.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8780487804878049, (2, 1): 0.0975609756097561, (2, 2): 0.024390243902439025}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8780487804878049, (2, 1): 0.0975609756097561, (2, 2): 0.024390243902439025}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 36.0}
in get_filtered_urn(filter=0) --- total: total=38.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02631578947368421, (0, 1): 0.02631578947368421, (0, 2): 0.9473684210526315}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02631578947368421, (0, 1): 0.02631578947368421, (0, 2): 0.9473684210526315}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 36.0 -> 37.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 36.0 -> 37.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 22.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=28.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7857142857142857, (1, 1): 0.07142857142857142, (1, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7857142857142857, (1, 1): 0.07142857142857142, (1, 2): 0.14285714285714285}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 22.0, (0, 2): 6.0}
in get_filtered_urn(filter=0) --- total: total=30.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.06666666666666667, (0, 1): 0.7333333333333333, (0, 2): 0.2}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.06666666666666667, (0, 1): 0.7333333333333333, (0, 2): 0.2}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 22.0 -> 23.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 22.0 -> 23.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 46.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=48.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.020833333333333332, (0, 1): 0.9583333333333334, (0, 2): 0.020833333333333332}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.020833333333333332, (0, 1): 0.9583333333333334, (0, 2): 0.020833333333333332}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 46.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=51.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9019607843137255, (1, 1): 0.0196078431372549, (1, 2): 0.0784313725490196}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9019607843137255, (1, 1): 0.0196078431372549, (1, 2): 0.0784313725490196}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 46.0 -> 47.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 46.0 -> 47.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 6.0, (2, 1): 17.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=25.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.24, (2, 1): 0.68, (2, 2): 0.08}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.24, (2, 1): 0.68, (2, 2): 0.08}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 9.0, (1, 1): 2.0, (1, 2): 17.0}
in get_filtered_urn(filter=1) --- total: total=28.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.32142857142857145, (1, 1): 0.07142857142857142, (1, 2): 0.6071428571428571}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.32142857142857145, (1, 1): 0.07142857142857142, (1, 2): 0.6071428571428571}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 17.0 -> 18.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 17.0 -> 18.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 37.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=42.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8809523809523809, (2, 1): 0.09523809523809523, (2, 2): 0.023809523809523808}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8809523809523809, (2, 1): 0.09523809523809523, (2, 2): 0.023809523809523808}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 37.0}
in get_filtered_urn(filter=0) --- total: total=39.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02564102564102564, (0, 1): 0.02564102564102564, (0, 2): 0.9487179487179487}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02564102564102564, (0, 1): 0.02564102564102564, (0, 2): 0.9487179487179487}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 37.0 -> 38.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 37.0 -> 38.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 9.0, (0, 2): 31.0}
in get_filtered_urn(filter=0) --- total: total=42.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.047619047619047616, (0, 1): 0.21428571428571427, (0, 2): 0.7380952380952381}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.047619047619047616, (0, 1): 0.21428571428571427, (0, 2): 0.7380952380952381}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 31.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=37.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8378378378378378, (2, 1): 0.10810810810810811, (2, 2): 0.05405405405405406}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8378378378378378, (2, 1): 0.10810810810810811, (2, 2): 0.05405405405405406}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 31.0 -> 32.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 31.0 -> 32.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 47.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=49.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02040816326530612, (0, 1): 0.9591836734693877, (0, 2): 0.02040816326530612}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.02040816326530612, (0, 1): 0.9591836734693877, (0, 2): 0.02040816326530612}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 47.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=52.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9038461538461539, (1, 1): 0.019230769230769232, (1, 2): 0.07692307692307693}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9038461538461539, (1, 1): 0.019230769230769232, (1, 2): 0.07692307692307693}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 47.0 -> 48.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 47.0 -> 48.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 9.0, (0, 2): 32.0}
in get_filtered_urn(filter=0) --- total: total=43.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.046511627906976744, (0, 1): 0.20930232558139536, (0, 2): 0.7441860465116279}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.046511627906976744, (0, 1): 0.20930232558139536, (0, 2): 0.7441860465116279}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 32.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=38.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8421052631578947, (2, 1): 0.10526315789473684, (2, 2): 0.05263157894736842}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8421052631578947, (2, 1): 0.10526315789473684, (2, 2): 0.05263157894736842}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 32.0 -> 33.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 32.0 -> 33.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 38.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=43.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8837209302325582, (2, 1): 0.09302325581395349, (2, 2): 0.023255813953488372}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8837209302325582, (2, 1): 0.09302325581395349, (2, 2): 0.023255813953488372}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 38.0}
in get_filtered_urn(filter=0) --- total: total=40.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.025, (0, 1): 0.025, (0, 2): 0.95}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.025, (0, 1): 0.025, (0, 2): 0.95}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 38.0 -> 39.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 38.0 -> 39.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 23.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=29.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.7931034482758621, (1, 1): 0.06896551724137931, (1, 2): 0.13793103448275862}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.7931034482758621, (1, 1): 0.06896551724137931, (1, 2): 0.13793103448275862}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 23.0, (0, 2): 6.0}
in get_filtered_urn(filter=0) --- total: total=31.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.06451612903225806, (0, 1): 0.7419354838709677, (0, 2): 0.1935483870967742}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.06451612903225806, (0, 1): 0.7419354838709677, (0, 2): 0.1935483870967742}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 23.0 -> 24.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 23.0 -> 24.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 48.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=50.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02, (0, 1): 0.96, (0, 2): 0.02}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.02, (0, 1): 0.96, (0, 2): 0.02}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 48.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=53.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9056603773584906, (1, 1): 0.018867924528301886, (1, 2): 0.07547169811320754}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9056603773584906, (1, 1): 0.018867924528301886, (1, 2): 0.07547169811320754}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 48.0 -> 49.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 48.0 -> 49.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 9.0, (0, 2): 33.0}
in get_filtered_urn(filter=0) --- total: total=44.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.045454545454545456, (0, 1): 0.20454545454545456, (0, 2): 0.75}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.045454545454545456, (0, 1): 0.20454545454545456, (0, 2): 0.75}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 33.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=39.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8461538461538461, (2, 1): 0.10256410256410256, (2, 2): 0.05128205128205128}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.8461538461538461, (2, 1): 0.10256410256410256, (2, 2): 0.05128205128205128}
in decode_message(signal=2) Receiver 5 got option: (2, 1) and decoded action: 1
Receiver 5 received signals: [2] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 2): 33.0 -> 33.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 1): 4.0 -> 4.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 39.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=44.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8863636363636364, (2, 1): 0.09090909090909091, (2, 2): 0.022727272727272728}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8863636363636364, (2, 1): 0.09090909090909091, (2, 2): 0.022727272727272728}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 39.0}
in get_filtered_urn(filter=0) --- total: total=41.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.024390243902439025, (0, 1): 0.024390243902439025, (0, 2): 0.9512195121951219}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.024390243902439025, (0, 1): 0.024390243902439025, (0, 2): 0.9512195121951219}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 39.0 -> 40.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 39.0 -> 40.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 9.0, (0, 2): 33.0}
in get_filtered_urn(filter=0) --- total: total=44.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.045454545454545456, (0, 1): 0.20454545454545456, (0, 2): 0.75}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.045454545454545456, (0, 1): 0.20454545454545456, (0, 2): 0.75}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 9.0, (1, 1): 2.0, (1, 2): 18.0}
in get_filtered_urn(filter=1) --- total: total=29.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3103448275862069, (1, 1): 0.06896551724137931, (1, 2): 0.6206896551724138}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.3103448275862069, (1, 1): 0.06896551724137931, (1, 2): 0.6206896551724138}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 1): 9.0 -> 10.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 0): 9.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 59.0}
in get_filtered_urn(filter=1) --- total: total=61.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.01639344262295082, (1, 1): 0.01639344262295082, (1, 2): 0.9672131147540983}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.01639344262295082, (1, 1): 0.01639344262295082, (1, 2): 0.9672131147540983}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 59.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=61.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.01639344262295082, (2, 1): 0.9672131147540983, (2, 2): 0.01639344262295082}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.01639344262295082, (2, 1): 0.9672131147540983, (2, 2): 0.01639344262295082}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 59.0 -> 60.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 59.0 -> 60.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 24.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=30.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8, (1, 1): 0.06666666666666667, (1, 2): 0.13333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8, (1, 1): 0.06666666666666667, (1, 2): 0.13333333333333333}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 24.0, (0, 2): 6.0}
in get_filtered_urn(filter=0) --- total: total=32.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0625, (0, 1): 0.75, (0, 2): 0.1875}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0625, (0, 1): 0.75, (0, 2): 0.1875}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 24.0 -> 25.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 24.0 -> 25.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 40.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=45.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8888888888888888, (2, 1): 0.08888888888888889, (2, 2): 0.022222222222222223}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.8888888888888888, (2, 1): 0.08888888888888889, (2, 2): 0.022222222222222223}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 49.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=54.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9074074074074074, (1, 1): 0.018518518518518517, (1, 2): 0.07407407407407407}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9074074074074074, (1, 1): 0.018518518518518517, (1, 2): 0.07407407407407407}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 1): 4.0 -> 4.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 0): 49.0 -> 49.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 33.0}
in get_filtered_urn(filter=0) --- total: total=45.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.044444444444444446, (0, 1): 0.2222222222222222, (0, 2): 0.7333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.044444444444444446, (0, 1): 0.2222222222222222, (0, 2): 0.7333333333333333}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 18.0}
in get_filtered_urn(filter=1) --- total: total=30.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3333333333333333, (1, 1): 0.06666666666666667, (1, 2): 0.6}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.3333333333333333, (1, 1): 0.06666666666666667, (1, 2): 0.6}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 18.0 -> 18.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 60.0}
in get_filtered_urn(filter=1) --- total: total=62.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.016129032258064516, (1, 1): 0.016129032258064516, (1, 2): 0.967741935483871}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.016129032258064516, (1, 1): 0.016129032258064516, (1, 2): 0.967741935483871}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 60.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=62.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.016129032258064516, (2, 1): 0.967741935483871, (2, 2): 0.016129032258064516}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.016129032258064516, (2, 1): 0.967741935483871, (2, 2): 0.016129032258064516}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 60.0 -> 61.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 60.0 -> 61.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 33.0}
in get_filtered_urn(filter=0) --- total: total=45.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.044444444444444446, (0, 1): 0.2222222222222222, (0, 2): 0.7333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.044444444444444446, (0, 1): 0.2222222222222222, (0, 2): 0.7333333333333333}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 33.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=39.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8461538461538461, (2, 1): 0.10256410256410256, (2, 2): 0.05128205128205128}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8461538461538461, (2, 1): 0.10256410256410256, (2, 2): 0.05128205128205128}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 33.0 -> 34.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 33.0 -> 34.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 61.0}
in get_filtered_urn(filter=1) --- total: total=63.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.015873015873015872, (1, 1): 0.015873015873015872, (1, 2): 0.9682539682539683}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.015873015873015872, (1, 1): 0.015873015873015872, (1, 2): 0.9682539682539683}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 61.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=63.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.015873015873015872, (2, 1): 0.9682539682539683, (2, 2): 0.015873015873015872}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.015873015873015872, (2, 1): 0.9682539682539683, (2, 2): 0.015873015873015872}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 61.0 -> 62.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 61.0 -> 62.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 25.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=31.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8064516129032258, (1, 1): 0.06451612903225806, (1, 2): 0.12903225806451613}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8064516129032258, (1, 1): 0.06451612903225806, (1, 2): 0.12903225806451613}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 25.0, (0, 2): 6.0}
in get_filtered_urn(filter=0) --- total: total=33.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.06060606060606061, (0, 1): 0.7575757575757576, (0, 2): 0.18181818181818182}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.06060606060606061, (0, 1): 0.7575757575757576, (0, 2): 0.18181818181818182}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 25.0 -> 25.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 6.0 -> 6.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 62.0}
in get_filtered_urn(filter=1) --- total: total=64.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.015625, (1, 1): 0.015625, (1, 2): 0.96875}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.015625, (1, 1): 0.015625, (1, 2): 0.96875}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 62.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=64.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.015625, (2, 1): 0.96875, (2, 2): 0.015625}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.015625, (2, 1): 0.96875, (2, 2): 0.015625}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 62.0 -> 63.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 62.0 -> 63.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 34.0}
in get_filtered_urn(filter=0) --- total: total=46.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.043478260869565216, (0, 1): 0.21739130434782608, (0, 2): 0.7391304347826086}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.043478260869565216, (0, 1): 0.21739130434782608, (0, 2): 0.7391304347826086}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 18.0}
in get_filtered_urn(filter=1) --- total: total=30.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3333333333333333, (1, 1): 0.06666666666666667, (1, 2): 0.6}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.3333333333333333, (1, 1): 0.06666666666666667, (1, 2): 0.6}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 18.0 -> 18.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 63.0}
in get_filtered_urn(filter=1) --- total: total=65.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.015384615384615385, (1, 1): 0.015384615384615385, (1, 2): 0.9692307692307692}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.015384615384615385, (1, 1): 0.015384615384615385, (1, 2): 0.9692307692307692}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 63.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=65.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.015384615384615385, (2, 1): 0.9692307692307692, (2, 2): 0.015384615384615385}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.015384615384615385, (2, 1): 0.9692307692307692, (2, 2): 0.015384615384615385}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 63.0 -> 64.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 63.0 -> 64.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 25.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=31.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8064516129032258, (1, 1): 0.06451612903225806, (1, 2): 0.12903225806451613}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8064516129032258, (1, 1): 0.06451612903225806, (1, 2): 0.12903225806451613}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 25.0, (0, 2): 6.0}
in get_filtered_urn(filter=0) --- total: total=33.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.06060606060606061, (0, 1): 0.7575757575757576, (0, 2): 0.18181818181818182}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.06060606060606061, (0, 1): 0.7575757575757576, (0, 2): 0.18181818181818182}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 25.0 -> 26.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 25.0 -> 26.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 40.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=45.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8888888888888888, (2, 1): 0.08888888888888889, (2, 2): 0.022222222222222223}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8888888888888888, (2, 1): 0.08888888888888889, (2, 2): 0.022222222222222223}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 40.0}
in get_filtered_urn(filter=0) --- total: total=42.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.023809523809523808, (0, 1): 0.023809523809523808, (0, 2): 0.9523809523809523}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.023809523809523808, (0, 1): 0.023809523809523808, (0, 2): 0.9523809523809523}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 40.0 -> 41.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 40.0 -> 41.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 26.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=32.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8125, (1, 1): 0.0625, (1, 2): 0.125}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8125, (1, 1): 0.0625, (1, 2): 0.125}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 26.0, (0, 2): 6.0}
in get_filtered_urn(filter=0) --- total: total=34.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.058823529411764705, (0, 1): 0.7647058823529411, (0, 2): 0.17647058823529413}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.058823529411764705, (0, 1): 0.7647058823529411, (0, 2): 0.17647058823529413}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 26.0 -> 26.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 6.0 -> 6.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 49.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=51.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0196078431372549, (0, 1): 0.9607843137254902, (0, 2): 0.0196078431372549}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0196078431372549, (0, 1): 0.9607843137254902, (0, 2): 0.0196078431372549}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 49.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=54.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9074074074074074, (1, 1): 0.018518518518518517, (1, 2): 0.07407407407407407}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9074074074074074, (1, 1): 0.018518518518518517, (1, 2): 0.07407407407407407}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 49.0 -> 50.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 49.0 -> 50.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 26.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=32.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8125, (1, 1): 0.0625, (1, 2): 0.125}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8125, (1, 1): 0.0625, (1, 2): 0.125}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 26.0, (0, 2): 6.0}
in get_filtered_urn(filter=0) --- total: total=34.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.058823529411764705, (0, 1): 0.7647058823529411, (0, 2): 0.17647058823529413}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.058823529411764705, (0, 1): 0.7647058823529411, (0, 2): 0.17647058823529413}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 26.0 -> 27.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 26.0 -> 27.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 41.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=46.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8913043478260869, (2, 1): 0.08695652173913043, (2, 2): 0.021739130434782608}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8913043478260869, (2, 1): 0.08695652173913043, (2, 2): 0.021739130434782608}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 41.0}
in get_filtered_urn(filter=0) --- total: total=43.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.023255813953488372, (0, 1): 0.023255813953488372, (0, 2): 0.9534883720930233}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.023255813953488372, (0, 1): 0.023255813953488372, (0, 2): 0.9534883720930233}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 41.0 -> 42.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 41.0 -> 42.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 6.0, (2, 1): 18.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=26.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.23076923076923078, (2, 1): 0.6923076923076923, (2, 2): 0.07692307692307693}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.23076923076923078, (2, 1): 0.6923076923076923, (2, 2): 0.07692307692307693}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 18.0}
in get_filtered_urn(filter=1) --- total: total=30.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3333333333333333, (1, 1): 0.06666666666666667, (1, 2): 0.6}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.3333333333333333, (1, 1): 0.06666666666666667, (1, 2): 0.6}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 18.0 -> 19.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 18.0 -> 19.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 42.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=47.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8936170212765957, (2, 1): 0.0851063829787234, (2, 2): 0.02127659574468085}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8936170212765957, (2, 1): 0.0851063829787234, (2, 2): 0.02127659574468085}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 42.0}
in get_filtered_urn(filter=0) --- total: total=44.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.022727272727272728, (0, 1): 0.022727272727272728, (0, 2): 0.9545454545454546}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.022727272727272728, (0, 1): 0.022727272727272728, (0, 2): 0.9545454545454546}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 42.0 -> 43.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 42.0 -> 43.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 6.0, (2, 1): 19.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=27.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.2222222222222222, (2, 1): 0.7037037037037037, (2, 2): 0.07407407407407407}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.2222222222222222, (2, 1): 0.7037037037037037, (2, 2): 0.07407407407407407}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 19.0}
in get_filtered_urn(filter=1) --- total: total=31.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3225806451612903, (1, 1): 0.06451612903225806, (1, 2): 0.6129032258064516}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.3225806451612903, (1, 1): 0.06451612903225806, (1, 2): 0.6129032258064516}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 19.0 -> 19.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 64.0}
in get_filtered_urn(filter=1) --- total: total=66.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.015151515151515152, (1, 1): 0.015151515151515152, (1, 2): 0.9696969696969697}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.015151515151515152, (1, 1): 0.015151515151515152, (1, 2): 0.9696969696969697}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 64.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=66.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.015151515151515152, (2, 1): 0.9696969696969697, (2, 2): 0.015151515151515152}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.015151515151515152, (2, 1): 0.9696969696969697, (2, 2): 0.015151515151515152}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 64.0 -> 65.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 64.0 -> 65.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 34.0}
in get_filtered_urn(filter=0) --- total: total=46.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.043478260869565216, (0, 1): 0.21739130434782608, (0, 2): 0.7391304347826086}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.043478260869565216, (0, 1): 0.21739130434782608, (0, 2): 0.7391304347826086}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 34.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=40.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.85, (2, 1): 0.1, (2, 2): 0.05}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.85, (2, 1): 0.1, (2, 2): 0.05}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 34.0 -> 35.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 34.0 -> 35.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 50.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=52.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.019230769230769232, (0, 1): 0.9615384615384616, (0, 2): 0.019230769230769232}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.019230769230769232, (0, 1): 0.9615384615384616, (0, 2): 0.019230769230769232}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 50.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=55.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9090909090909091, (1, 1): 0.01818181818181818, (1, 2): 0.07272727272727272}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9090909090909091, (1, 1): 0.01818181818181818, (1, 2): 0.07272727272727272}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 50.0 -> 51.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 50.0 -> 51.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 27.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=33.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8181818181818182, (1, 1): 0.06060606060606061, (1, 2): 0.12121212121212122}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.8181818181818182, (1, 1): 0.06060606060606061, (1, 2): 0.12121212121212122}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 35.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=41.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8536585365853658, (2, 1): 0.0975609756097561, (2, 2): 0.04878048780487805}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8536585365853658, (2, 1): 0.0975609756097561, (2, 2): 0.04878048780487805}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 35.0 -> 35.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 51.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=53.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.018867924528301886, (0, 1): 0.9622641509433962, (0, 2): 0.018867924528301886}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.018867924528301886, (0, 1): 0.9622641509433962, (0, 2): 0.018867924528301886}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 51.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=56.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9107142857142857, (1, 1): 0.017857142857142856, (1, 2): 0.07142857142857142}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9107142857142857, (1, 1): 0.017857142857142856, (1, 2): 0.07142857142857142}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 51.0 -> 52.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 51.0 -> 52.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 27.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=33.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8181818181818182, (1, 1): 0.06060606060606061, (1, 2): 0.12121212121212122}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8181818181818182, (1, 1): 0.06060606060606061, (1, 2): 0.12121212121212122}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 27.0, (0, 2): 6.0}
in get_filtered_urn(filter=0) --- total: total=35.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05714285714285714, (0, 1): 0.7714285714285715, (0, 2): 0.17142857142857143}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.05714285714285714, (0, 1): 0.7714285714285715, (0, 2): 0.17142857142857143}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 27.0 -> 27.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 6.0 -> 6.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 65.0}
in get_filtered_urn(filter=1) --- total: total=67.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.014925373134328358, (1, 1): 0.014925373134328358, (1, 2): 0.9701492537313433}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.014925373134328358, (1, 1): 0.014925373134328358, (1, 2): 0.9701492537313433}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 65.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=67.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.014925373134328358, (2, 1): 0.9701492537313433, (2, 2): 0.014925373134328358}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.014925373134328358, (2, 1): 0.9701492537313433, (2, 2): 0.014925373134328358}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 65.0 -> 66.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 65.0 -> 66.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 6.0, (2, 1): 19.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=27.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.2222222222222222, (2, 1): 0.7037037037037037, (2, 2): 0.07407407407407407}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.2222222222222222, (2, 1): 0.7037037037037037, (2, 2): 0.07407407407407407}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 27.0, (0, 2): 6.0}
in get_filtered_urn(filter=0) --- total: total=35.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05714285714285714, (0, 1): 0.7714285714285715, (0, 2): 0.17142857142857143}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.05714285714285714, (0, 1): 0.7714285714285715, (0, 2): 0.17142857142857143}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 0): 6.0 -> 7.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 2): 6.0 -> 7.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 66.0}
in get_filtered_urn(filter=1) --- total: total=68.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.014705882352941176, (1, 1): 0.014705882352941176, (1, 2): 0.9705882352941176}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.014705882352941176, (1, 1): 0.014705882352941176, (1, 2): 0.9705882352941176}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 66.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=68.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.014705882352941176, (2, 1): 0.9705882352941176, (2, 2): 0.014705882352941176}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.014705882352941176, (2, 1): 0.9705882352941176, (2, 2): 0.014705882352941176}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 66.0 -> 67.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 66.0 -> 67.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 7.0, (2, 1): 19.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=28.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.25, (2, 1): 0.6785714285714286, (2, 2): 0.07142857142857142}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.25, (2, 1): 0.6785714285714286, (2, 2): 0.07142857142857142}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 19.0}
in get_filtered_urn(filter=1) --- total: total=31.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3225806451612903, (1, 1): 0.06451612903225806, (1, 2): 0.6129032258064516}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.3225806451612903, (1, 1): 0.06451612903225806, (1, 2): 0.6129032258064516}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 19.0 -> 20.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 19.0 -> 20.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 52.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=54.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.018518518518518517, (0, 1): 0.9629629629629629, (0, 2): 0.018518518518518517}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.018518518518518517, (0, 1): 0.9629629629629629, (0, 2): 0.018518518518518517}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 52.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=57.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9122807017543859, (1, 1): 0.017543859649122806, (1, 2): 0.07017543859649122}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9122807017543859, (1, 1): 0.017543859649122806, (1, 2): 0.07017543859649122}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 52.0 -> 53.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 52.0 -> 53.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 7.0, (2, 1): 20.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=29.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.2413793103448276, (2, 1): 0.6896551724137931, (2, 2): 0.06896551724137931}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.2413793103448276, (2, 1): 0.6896551724137931, (2, 2): 0.06896551724137931}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 20.0}
in get_filtered_urn(filter=1) --- total: total=32.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3125, (1, 1): 0.0625, (1, 2): 0.625}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.3125, (1, 1): 0.0625, (1, 2): 0.625}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 20.0 -> 20.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 67.0}
in get_filtered_urn(filter=1) --- total: total=69.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.014492753623188406, (1, 1): 0.014492753623188406, (1, 2): 0.9710144927536232}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.014492753623188406, (1, 1): 0.014492753623188406, (1, 2): 0.9710144927536232}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 67.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=69.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.014492753623188406, (2, 1): 0.9710144927536232, (2, 2): 0.014492753623188406}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.014492753623188406, (2, 1): 0.9710144927536232, (2, 2): 0.014492753623188406}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 67.0 -> 68.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 67.0 -> 68.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 35.0}
in get_filtered_urn(filter=0) --- total: total=47.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0425531914893617, (0, 1): 0.2127659574468085, (0, 2): 0.7446808510638298}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0425531914893617, (0, 1): 0.2127659574468085, (0, 2): 0.7446808510638298}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 20.0}
in get_filtered_urn(filter=1) --- total: total=32.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3125, (1, 1): 0.0625, (1, 2): 0.625}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.3125, (1, 1): 0.0625, (1, 2): 0.625}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 20.0 -> 20.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 53.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=55.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01818181818181818, (0, 1): 0.9636363636363636, (0, 2): 0.01818181818181818}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.01818181818181818, (0, 1): 0.9636363636363636, (0, 2): 0.01818181818181818}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 53.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=58.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9137931034482759, (1, 1): 0.017241379310344827, (1, 2): 0.06896551724137931}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9137931034482759, (1, 1): 0.017241379310344827, (1, 2): 0.06896551724137931}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 53.0 -> 54.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 53.0 -> 54.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 7.0, (2, 1): 20.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=29.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.2413793103448276, (2, 1): 0.6896551724137931, (2, 2): 0.06896551724137931}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.2413793103448276, (2, 1): 0.6896551724137931, (2, 2): 0.06896551724137931}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 20.0}
in get_filtered_urn(filter=1) --- total: total=32.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3125, (1, 1): 0.0625, (1, 2): 0.625}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.3125, (1, 1): 0.0625, (1, 2): 0.625}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 20.0 -> 20.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 43.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=48.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8958333333333334, (2, 1): 0.08333333333333333, (2, 2): 0.020833333333333332}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8958333333333334, (2, 1): 0.08333333333333333, (2, 2): 0.020833333333333332}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 43.0}
in get_filtered_urn(filter=0) --- total: total=45.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.022222222222222223, (0, 1): 0.022222222222222223, (0, 2): 0.9555555555555556}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.022222222222222223, (0, 1): 0.022222222222222223, (0, 2): 0.9555555555555556}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 43.0 -> 44.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 43.0 -> 44.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 35.0}
in get_filtered_urn(filter=0) --- total: total=47.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0425531914893617, (0, 1): 0.2127659574468085, (0, 2): 0.7446808510638298}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0425531914893617, (0, 1): 0.2127659574468085, (0, 2): 0.7446808510638298}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 35.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=41.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8536585365853658, (2, 1): 0.0975609756097561, (2, 2): 0.04878048780487805}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8536585365853658, (2, 1): 0.0975609756097561, (2, 2): 0.04878048780487805}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 35.0 -> 36.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 35.0 -> 36.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 54.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=56.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.017857142857142856, (0, 1): 0.9642857142857143, (0, 2): 0.017857142857142856}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.017857142857142856, (0, 1): 0.9642857142857143, (0, 2): 0.017857142857142856}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 54.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=59.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9152542372881356, (1, 1): 0.01694915254237288, (1, 2): 0.06779661016949153}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9152542372881356, (1, 1): 0.01694915254237288, (1, 2): 0.06779661016949153}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 54.0 -> 55.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 54.0 -> 55.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 7.0, (2, 1): 20.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=29.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.2413793103448276, (2, 1): 0.6896551724137931, (2, 2): 0.06896551724137931}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.2413793103448276, (2, 1): 0.6896551724137931, (2, 2): 0.06896551724137931}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 20.0}
in get_filtered_urn(filter=1) --- total: total=32.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3125, (1, 1): 0.0625, (1, 2): 0.625}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.3125, (1, 1): 0.0625, (1, 2): 0.625}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 20.0 -> 20.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 68.0}
in get_filtered_urn(filter=1) --- total: total=70.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.014285714285714285, (1, 1): 0.014285714285714285, (1, 2): 0.9714285714285714}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.014285714285714285, (1, 1): 0.014285714285714285, (1, 2): 0.9714285714285714}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 68.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=70.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.014285714285714285, (2, 1): 0.9714285714285714, (2, 2): 0.014285714285714285}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.014285714285714285, (2, 1): 0.9714285714285714, (2, 2): 0.014285714285714285}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 68.0 -> 69.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 68.0 -> 69.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 27.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=33.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8181818181818182, (1, 1): 0.06060606060606061, (1, 2): 0.12121212121212122}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8181818181818182, (1, 1): 0.06060606060606061, (1, 2): 0.12121212121212122}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 27.0, (0, 2): 7.0}
in get_filtered_urn(filter=0) --- total: total=36.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05555555555555555, (0, 1): 0.75, (0, 2): 0.19444444444444445}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.05555555555555555, (0, 1): 0.75, (0, 2): 0.19444444444444445}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 27.0 -> 28.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 27.0 -> 28.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 55.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=57.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.017543859649122806, (0, 1): 0.9649122807017544, (0, 2): 0.017543859649122806}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.017543859649122806, (0, 1): 0.9649122807017544, (0, 2): 0.017543859649122806}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 55.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=60.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9166666666666666, (1, 1): 0.016666666666666666, (1, 2): 0.06666666666666667}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9166666666666666, (1, 1): 0.016666666666666666, (1, 2): 0.06666666666666667}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 55.0 -> 56.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 55.0 -> 56.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 28.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=34.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8235294117647058, (1, 1): 0.058823529411764705, (1, 2): 0.11764705882352941}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8235294117647058, (1, 1): 0.058823529411764705, (1, 2): 0.11764705882352941}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 28.0, (0, 2): 7.0}
in get_filtered_urn(filter=0) --- total: total=37.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05405405405405406, (0, 1): 0.7567567567567568, (0, 2): 0.1891891891891892}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.05405405405405406, (0, 1): 0.7567567567567568, (0, 2): 0.1891891891891892}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 28.0 -> 28.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 7.0 -> 7.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 44.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=49.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8979591836734694, (2, 1): 0.08163265306122448, (2, 2): 0.02040816326530612}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8979591836734694, (2, 1): 0.08163265306122448, (2, 2): 0.02040816326530612}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 44.0}
in get_filtered_urn(filter=0) --- total: total=46.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.021739130434782608, (0, 1): 0.021739130434782608, (0, 2): 0.9565217391304348}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.021739130434782608, (0, 1): 0.021739130434782608, (0, 2): 0.9565217391304348}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 44.0 -> 45.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 44.0 -> 45.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 7.0, (2, 1): 20.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=29.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.2413793103448276, (2, 1): 0.6896551724137931, (2, 2): 0.06896551724137931}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.2413793103448276, (2, 1): 0.6896551724137931, (2, 2): 0.06896551724137931}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 20.0}
in get_filtered_urn(filter=1) --- total: total=32.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.3125, (1, 1): 0.0625, (1, 2): 0.625}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.3125, (1, 1): 0.0625, (1, 2): 0.625}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 20.0 -> 21.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 20.0 -> 21.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 56.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=58.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.017241379310344827, (0, 1): 0.9655172413793104, (0, 2): 0.017241379310344827}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.017241379310344827, (0, 1): 0.9655172413793104, (0, 2): 0.017241379310344827}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 56.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=61.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9180327868852459, (1, 1): 0.01639344262295082, (1, 2): 0.06557377049180328}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9180327868852459, (1, 1): 0.01639344262295082, (1, 2): 0.06557377049180328}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 56.0 -> 57.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 56.0 -> 57.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 28.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=34.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8235294117647058, (1, 1): 0.058823529411764705, (1, 2): 0.11764705882352941}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.8235294117647058, (1, 1): 0.058823529411764705, (1, 2): 0.11764705882352941}
Sender 4 got filter 1 choose option: (1, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 21.0}
in get_filtered_urn(filter=1) --- total: total=33.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.30303030303030304, (1, 1): 0.06060606060606061, (1, 2): 0.6363636363636364}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.30303030303030304, (1, 1): 0.06060606060606061, (1, 2): 0.6363636363636364}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 1): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 21.0 -> 21.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 69.0}
in get_filtered_urn(filter=1) --- total: total=71.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.014084507042253521, (1, 1): 0.014084507042253521, (1, 2): 0.971830985915493}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.014084507042253521, (1, 1): 0.014084507042253521, (1, 2): 0.971830985915493}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 69.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=71.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.014084507042253521, (2, 1): 0.971830985915493, (2, 2): 0.014084507042253521}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.014084507042253521, (2, 1): 0.971830985915493, (2, 2): 0.014084507042253521}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 69.0 -> 70.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 69.0 -> 70.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 36.0}
in get_filtered_urn(filter=0) --- total: total=48.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.041666666666666664, (0, 1): 0.20833333333333334, (0, 2): 0.75}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.041666666666666664, (0, 1): 0.20833333333333334, (0, 2): 0.75}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 36.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=42.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8571428571428571, (2, 1): 0.09523809523809523, (2, 2): 0.047619047619047616}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8571428571428571, (2, 1): 0.09523809523809523, (2, 2): 0.047619047619047616}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 36.0 -> 37.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 36.0 -> 37.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 70.0}
in get_filtered_urn(filter=1) --- total: total=72.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.013888888888888888, (1, 1): 0.013888888888888888, (1, 2): 0.9722222222222222}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.013888888888888888, (1, 1): 0.013888888888888888, (1, 2): 0.9722222222222222}
Sender 1 got filter 1 choose option: (1, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 45.0}
in get_filtered_urn(filter=0) --- total: total=47.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02127659574468085, (0, 1): 0.02127659574468085, (0, 2): 0.9574468085106383}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02127659574468085, (0, 1): 0.02127659574468085, (0, 2): 0.9574468085106383}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (1, 0): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 2): 45.0 -> 45.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 7.0, (2, 1): 21.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=30.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.23333333333333334, (2, 1): 0.7, (2, 2): 0.06666666666666667}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.23333333333333334, (2, 1): 0.7, (2, 2): 0.06666666666666667}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 21.0}
in get_filtered_urn(filter=1) --- total: total=33.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.30303030303030304, (1, 1): 0.06060606060606061, (1, 2): 0.6363636363636364}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.30303030303030304, (1, 1): 0.06060606060606061, (1, 2): 0.6363636363636364}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 21.0 -> 22.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 21.0 -> 22.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 57.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=59.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01694915254237288, (0, 1): 0.9661016949152542, (0, 2): 0.01694915254237288}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.01694915254237288, (0, 1): 0.9661016949152542, (0, 2): 0.01694915254237288}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 57.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=62.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9193548387096774, (1, 1): 0.016129032258064516, (1, 2): 0.06451612903225806}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9193548387096774, (1, 1): 0.016129032258064516, (1, 2): 0.06451612903225806}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 57.0 -> 58.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 57.0 -> 58.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 37.0}
in get_filtered_urn(filter=0) --- total: total=49.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.04081632653061224, (0, 1): 0.20408163265306123, (0, 2): 0.7551020408163265}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.04081632653061224, (0, 1): 0.20408163265306123, (0, 2): 0.7551020408163265}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 37.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=43.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8604651162790697, (2, 1): 0.09302325581395349, (2, 2): 0.046511627906976744}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8604651162790697, (2, 1): 0.09302325581395349, (2, 2): 0.046511627906976744}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 37.0 -> 38.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 37.0 -> 38.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 58.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=60.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.016666666666666666, (0, 1): 0.9666666666666667, (0, 2): 0.016666666666666666}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.016666666666666666, (0, 1): 0.9666666666666667, (0, 2): 0.016666666666666666}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 58.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=63.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9206349206349206, (1, 1): 0.015873015873015872, (1, 2): 0.06349206349206349}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9206349206349206, (1, 1): 0.015873015873015872, (1, 2): 0.06349206349206349}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 58.0 -> 59.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 58.0 -> 59.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 7.0, (2, 1): 22.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=31.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.22580645161290322, (2, 1): 0.7096774193548387, (2, 2): 0.06451612903225806}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.22580645161290322, (2, 1): 0.7096774193548387, (2, 2): 0.06451612903225806}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 28.0, (0, 2): 7.0}
in get_filtered_urn(filter=0) --- total: total=37.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05405405405405406, (0, 1): 0.7567567567567568, (0, 2): 0.1891891891891892}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.05405405405405406, (0, 1): 0.7567567567567568, (0, 2): 0.1891891891891892}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 7.0 -> 7.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 28.0 -> 28.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 70.0}
in get_filtered_urn(filter=1) --- total: total=72.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.013888888888888888, (1, 1): 0.013888888888888888, (1, 2): 0.9722222222222222}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.013888888888888888, (1, 1): 0.013888888888888888, (1, 2): 0.9722222222222222}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 70.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=72.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.013888888888888888, (2, 1): 0.9722222222222222, (2, 2): 0.013888888888888888}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.013888888888888888, (2, 1): 0.9722222222222222, (2, 2): 0.013888888888888888}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 70.0 -> 71.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 70.0 -> 71.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 28.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=34.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8235294117647058, (1, 1): 0.058823529411764705, (1, 2): 0.11764705882352941}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8235294117647058, (1, 1): 0.058823529411764705, (1, 2): 0.11764705882352941}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 28.0, (0, 2): 7.0}
in get_filtered_urn(filter=0) --- total: total=37.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05405405405405406, (0, 1): 0.7567567567567568, (0, 2): 0.1891891891891892}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.05405405405405406, (0, 1): 0.7567567567567568, (0, 2): 0.1891891891891892}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 28.0 -> 29.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 28.0 -> 29.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 71.0}
in get_filtered_urn(filter=1) --- total: total=73.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0136986301369863, (1, 1): 0.0136986301369863, (1, 2): 0.9726027397260274}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0136986301369863, (1, 1): 0.0136986301369863, (1, 2): 0.9726027397260274}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 71.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=73.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0136986301369863, (2, 1): 0.9726027397260274, (2, 2): 0.0136986301369863}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0136986301369863, (2, 1): 0.9726027397260274, (2, 2): 0.0136986301369863}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 71.0 -> 72.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 71.0 -> 72.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 38.0}
in get_filtered_urn(filter=0) --- total: total=50.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.04, (0, 1): 0.2, (0, 2): 0.76}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.04, (0, 1): 0.2, (0, 2): 0.76}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 38.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=44.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8636363636363636, (2, 1): 0.09090909090909091, (2, 2): 0.045454545454545456}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8636363636363636, (2, 1): 0.09090909090909091, (2, 2): 0.045454545454545456}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 38.0 -> 39.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 38.0 -> 39.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 72.0}
in get_filtered_urn(filter=1) --- total: total=74.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.013513513513513514, (1, 1): 0.013513513513513514, (1, 2): 0.972972972972973}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.013513513513513514, (1, 1): 0.013513513513513514, (1, 2): 0.972972972972973}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 72.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=74.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.013513513513513514, (2, 1): 0.972972972972973, (2, 2): 0.013513513513513514}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.013513513513513514, (2, 1): 0.972972972972973, (2, 2): 0.013513513513513514}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 72.0 -> 73.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 72.0 -> 73.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 29.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=35.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8285714285714286, (1, 1): 0.05714285714285714, (1, 2): 0.11428571428571428}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8285714285714286, (1, 1): 0.05714285714285714, (1, 2): 0.11428571428571428}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 29.0, (0, 2): 7.0}
in get_filtered_urn(filter=0) --- total: total=38.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05263157894736842, (0, 1): 0.7631578947368421, (0, 2): 0.18421052631578946}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.05263157894736842, (0, 1): 0.7631578947368421, (0, 2): 0.18421052631578946}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 29.0 -> 30.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 29.0 -> 30.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 45.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=50.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9, (2, 1): 0.08, (2, 2): 0.02}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9, (2, 1): 0.08, (2, 2): 0.02}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 45.0}
in get_filtered_urn(filter=0) --- total: total=47.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02127659574468085, (0, 1): 0.02127659574468085, (0, 2): 0.9574468085106383}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02127659574468085, (0, 1): 0.02127659574468085, (0, 2): 0.9574468085106383}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 45.0 -> 46.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 45.0 -> 46.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 7.0, (2, 1): 22.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=31.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.22580645161290322, (2, 1): 0.7096774193548387, (2, 2): 0.06451612903225806}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.22580645161290322, (2, 1): 0.7096774193548387, (2, 2): 0.06451612903225806}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 30.0, (0, 2): 7.0}
in get_filtered_urn(filter=0) --- total: total=39.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05128205128205128, (0, 1): 0.7692307692307693, (0, 2): 0.1794871794871795}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.05128205128205128, (0, 1): 0.7692307692307693, (0, 2): 0.1794871794871795}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 0): 7.0 -> 8.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 2): 7.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 59.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=61.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01639344262295082, (0, 1): 0.9672131147540983, (0, 2): 0.01639344262295082}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.01639344262295082, (0, 1): 0.9672131147540983, (0, 2): 0.01639344262295082}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 59.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=64.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.921875, (1, 1): 0.015625, (1, 2): 0.0625}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.921875, (1, 1): 0.015625, (1, 2): 0.0625}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 59.0 -> 60.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 59.0 -> 60.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 30.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=36.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8333333333333334, (1, 1): 0.05555555555555555, (1, 2): 0.1111111111111111}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8333333333333334, (1, 1): 0.05555555555555555, (1, 2): 0.1111111111111111}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 30.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=40.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.05, (0, 1): 0.75, (0, 2): 0.2}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.05, (0, 1): 0.75, (0, 2): 0.2}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 30.0 -> 31.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 30.0 -> 31.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 46.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=51.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9019607843137255, (2, 1): 0.0784313725490196, (2, 2): 0.0196078431372549}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9019607843137255, (2, 1): 0.0784313725490196, (2, 2): 0.0196078431372549}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 46.0}
in get_filtered_urn(filter=0) --- total: total=48.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.020833333333333332, (0, 1): 0.020833333333333332, (0, 2): 0.9583333333333334}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.020833333333333332, (0, 1): 0.020833333333333332, (0, 2): 0.9583333333333334}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 46.0 -> 47.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 46.0 -> 47.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 22.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=32.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.25, (2, 1): 0.6875, (2, 2): 0.0625}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.25, (2, 1): 0.6875, (2, 2): 0.0625}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 22.0}
in get_filtered_urn(filter=1) --- total: total=34.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.29411764705882354, (1, 1): 0.058823529411764705, (1, 2): 0.6470588235294118}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.29411764705882354, (1, 1): 0.058823529411764705, (1, 2): 0.6470588235294118}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 22.0 -> 23.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 22.0 -> 23.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 73.0}
in get_filtered_urn(filter=1) --- total: total=75.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.013333333333333334, (1, 1): 0.013333333333333334, (1, 2): 0.9733333333333334}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.013333333333333334, (1, 1): 0.013333333333333334, (1, 2): 0.9733333333333334}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 73.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=75.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.013333333333333334, (2, 1): 0.9733333333333334, (2, 2): 0.013333333333333334}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.013333333333333334, (2, 1): 0.9733333333333334, (2, 2): 0.013333333333333334}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 73.0 -> 74.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 73.0 -> 74.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 31.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=37.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8378378378378378, (1, 1): 0.05405405405405406, (1, 2): 0.10810810810810811}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8378378378378378, (1, 1): 0.05405405405405406, (1, 2): 0.10810810810810811}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 31.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=41.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.04878048780487805, (0, 1): 0.7560975609756098, (0, 2): 0.1951219512195122}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.04878048780487805, (0, 1): 0.7560975609756098, (0, 2): 0.1951219512195122}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 31.0 -> 32.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 31.0 -> 32.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 74.0}
in get_filtered_urn(filter=1) --- total: total=76.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.013157894736842105, (1, 1): 0.013157894736842105, (1, 2): 0.9736842105263158}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.013157894736842105, (1, 1): 0.013157894736842105, (1, 2): 0.9736842105263158}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 74.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=76.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.013157894736842105, (2, 1): 0.9736842105263158, (2, 2): 0.013157894736842105}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.013157894736842105, (2, 1): 0.9736842105263158, (2, 2): 0.013157894736842105}
in decode_message(signal=2) Receiver 2 got option: (2, 2) and decoded action: 2
Receiver 2 received signals: [2] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (1, 2): 74.0 -> 74.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 2): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 23.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=33.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.24242424242424243, (2, 1): 0.696969696969697, (2, 2): 0.06060606060606061}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.24242424242424243, (2, 1): 0.696969696969697, (2, 2): 0.06060606060606061}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 23.0}
in get_filtered_urn(filter=1) --- total: total=35.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.2857142857142857, (1, 1): 0.05714285714285714, (1, 2): 0.6571428571428571}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.2857142857142857, (1, 1): 0.05714285714285714, (1, 2): 0.6571428571428571}
in decode_message(signal=1) Receiver 5 got option: (1, 1) and decoded action: 1
Receiver 5 received signals: [1] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 23.0 -> 23.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 1): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 47.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=52.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9038461538461539, (2, 1): 0.07692307692307693, (2, 2): 0.019230769230769232}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9038461538461539, (2, 1): 0.07692307692307693, (2, 2): 0.019230769230769232}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 47.0}
in get_filtered_urn(filter=0) --- total: total=49.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02040816326530612, (0, 1): 0.02040816326530612, (0, 2): 0.9591836734693877}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02040816326530612, (0, 1): 0.02040816326530612, (0, 2): 0.9591836734693877}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 47.0 -> 48.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 47.0 -> 48.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 23.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=33.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.24242424242424243, (2, 1): 0.696969696969697, (2, 2): 0.06060606060606061}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.24242424242424243, (2, 1): 0.696969696969697, (2, 2): 0.06060606060606061}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 23.0}
in get_filtered_urn(filter=1) --- total: total=35.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.2857142857142857, (1, 1): 0.05714285714285714, (1, 2): 0.6571428571428571}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.2857142857142857, (1, 1): 0.05714285714285714, (1, 2): 0.6571428571428571}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 23.0 -> 23.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 48.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=53.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9056603773584906, (2, 1): 0.07547169811320754, (2, 2): 0.018867924528301886}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9056603773584906, (2, 1): 0.07547169811320754, (2, 2): 0.018867924528301886}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 48.0}
in get_filtered_urn(filter=0) --- total: total=50.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02, (0, 1): 0.02, (0, 2): 0.96}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02, (0, 1): 0.02, (0, 2): 0.96}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 48.0 -> 49.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 48.0 -> 49.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 23.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=33.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.24242424242424243, (2, 1): 0.696969696969697, (2, 2): 0.06060606060606061}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.24242424242424243, (2, 1): 0.696969696969697, (2, 2): 0.06060606060606061}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 23.0}
in get_filtered_urn(filter=1) --- total: total=35.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.2857142857142857, (1, 1): 0.05714285714285714, (1, 2): 0.6571428571428571}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.2857142857142857, (1, 1): 0.05714285714285714, (1, 2): 0.6571428571428571}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 23.0 -> 24.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 23.0 -> 24.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 49.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=54.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9074074074074074, (2, 1): 0.07407407407407407, (2, 2): 0.018518518518518517}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9074074074074074, (2, 1): 0.07407407407407407, (2, 2): 0.018518518518518517}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 49.0}
in get_filtered_urn(filter=0) --- total: total=51.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0196078431372549, (0, 1): 0.0196078431372549, (0, 2): 0.9607843137254902}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0196078431372549, (0, 1): 0.0196078431372549, (0, 2): 0.9607843137254902}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 49.0 -> 50.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 49.0 -> 50.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 32.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=38.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8421052631578947, (1, 1): 0.05263157894736842, (1, 2): 0.10526315789473684}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8421052631578947, (1, 1): 0.05263157894736842, (1, 2): 0.10526315789473684}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 32.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=42.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.047619047619047616, (0, 1): 0.7619047619047619, (0, 2): 0.19047619047619047}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.047619047619047616, (0, 1): 0.7619047619047619, (0, 2): 0.19047619047619047}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 32.0 -> 32.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 8.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 74.0}
in get_filtered_urn(filter=1) --- total: total=76.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.013157894736842105, (1, 1): 0.013157894736842105, (1, 2): 0.9736842105263158}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.013157894736842105, (1, 1): 0.013157894736842105, (1, 2): 0.9736842105263158}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 74.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=76.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.013157894736842105, (2, 1): 0.9736842105263158, (2, 2): 0.013157894736842105}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.013157894736842105, (2, 1): 0.9736842105263158, (2, 2): 0.013157894736842105}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 74.0 -> 75.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 74.0 -> 75.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 24.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=34.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.23529411764705882, (2, 1): 0.7058823529411765, (2, 2): 0.058823529411764705}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.23529411764705882, (2, 1): 0.7058823529411765, (2, 2): 0.058823529411764705}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 32.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=42.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.047619047619047616, (0, 1): 0.7619047619047619, (0, 2): 0.19047619047619047}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.047619047619047616, (0, 1): 0.7619047619047619, (0, 2): 0.19047619047619047}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 8.0 -> 8.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 32.0 -> 32.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 75.0}
in get_filtered_urn(filter=1) --- total: total=77.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.012987012987012988, (1, 1): 0.012987012987012988, (1, 2): 0.974025974025974}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.012987012987012988, (1, 1): 0.012987012987012988, (1, 2): 0.974025974025974}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 75.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=77.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.012987012987012988, (2, 1): 0.974025974025974, (2, 2): 0.012987012987012988}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.012987012987012988, (2, 1): 0.974025974025974, (2, 2): 0.012987012987012988}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 75.0 -> 76.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 75.0 -> 76.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 32.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=38.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8421052631578947, (1, 1): 0.05263157894736842, (1, 2): 0.10526315789473684}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.8421052631578947, (1, 1): 0.05263157894736842, (1, 2): 0.10526315789473684}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 39.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=45.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8666666666666667, (2, 1): 0.08888888888888889, (2, 2): 0.044444444444444446}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8666666666666667, (2, 1): 0.08888888888888889, (2, 2): 0.044444444444444446}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 39.0 -> 39.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 60.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=62.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.016129032258064516, (0, 1): 0.967741935483871, (0, 2): 0.016129032258064516}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.016129032258064516, (0, 1): 0.967741935483871, (0, 2): 0.016129032258064516}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 60.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=65.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9230769230769231, (1, 1): 0.015384615384615385, (1, 2): 0.06153846153846154}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9230769230769231, (1, 1): 0.015384615384615385, (1, 2): 0.06153846153846154}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 60.0 -> 61.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 60.0 -> 61.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 32.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=38.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8421052631578947, (1, 1): 0.05263157894736842, (1, 2): 0.10526315789473684}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8421052631578947, (1, 1): 0.05263157894736842, (1, 2): 0.10526315789473684}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 32.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=42.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.047619047619047616, (0, 1): 0.7619047619047619, (0, 2): 0.19047619047619047}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.047619047619047616, (0, 1): 0.7619047619047619, (0, 2): 0.19047619047619047}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 32.0 -> 33.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 32.0 -> 33.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 76.0}
in get_filtered_urn(filter=1) --- total: total=78.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.01282051282051282, (1, 1): 0.01282051282051282, (1, 2): 0.9743589743589743}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.01282051282051282, (1, 1): 0.01282051282051282, (1, 2): 0.9743589743589743}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 76.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=78.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.01282051282051282, (2, 1): 0.9743589743589743, (2, 2): 0.01282051282051282}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.01282051282051282, (2, 1): 0.9743589743589743, (2, 2): 0.01282051282051282}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 76.0 -> 77.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 76.0 -> 77.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 33.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=39.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8461538461538461, (1, 1): 0.05128205128205128, (1, 2): 0.10256410256410256}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8461538461538461, (1, 1): 0.05128205128205128, (1, 2): 0.10256410256410256}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 33.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=43.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.046511627906976744, (0, 1): 0.7674418604651163, (0, 2): 0.18604651162790697}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.046511627906976744, (0, 1): 0.7674418604651163, (0, 2): 0.18604651162790697}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 33.0 -> 33.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 8.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 77.0}
in get_filtered_urn(filter=1) --- total: total=79.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.012658227848101266, (1, 1): 0.012658227848101266, (1, 2): 0.9746835443037974}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.012658227848101266, (1, 1): 0.012658227848101266, (1, 2): 0.9746835443037974}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 77.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=79.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.012658227848101266, (2, 1): 0.9746835443037974, (2, 2): 0.012658227848101266}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.012658227848101266, (2, 1): 0.9746835443037974, (2, 2): 0.012658227848101266}
in decode_message(signal=2) Receiver 2 got option: (2, 2) and decoded action: 2
Receiver 2 received signals: [2] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (1, 2): 77.0 -> 77.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 2): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 33.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=39.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8461538461538461, (1, 1): 0.05128205128205128, (1, 2): 0.10256410256410256}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8461538461538461, (1, 1): 0.05128205128205128, (1, 2): 0.10256410256410256}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 33.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=43.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.046511627906976744, (0, 1): 0.7674418604651163, (0, 2): 0.18604651162790697}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.046511627906976744, (0, 1): 0.7674418604651163, (0, 2): 0.18604651162790697}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 33.0 -> 34.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 33.0 -> 34.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 61.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=63.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015873015873015872, (0, 1): 0.9682539682539683, (0, 2): 0.015873015873015872}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.015873015873015872, (0, 1): 0.9682539682539683, (0, 2): 0.015873015873015872}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 61.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=66.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9242424242424242, (1, 1): 0.015151515151515152, (1, 2): 0.06060606060606061}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9242424242424242, (1, 1): 0.015151515151515152, (1, 2): 0.06060606060606061}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 61.0 -> 62.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 61.0 -> 62.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 34.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=40.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.85, (1, 1): 0.05, (1, 2): 0.1}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.85, (1, 1): 0.05, (1, 2): 0.1}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 34.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=44.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.045454545454545456, (0, 1): 0.7727272727272727, (0, 2): 0.18181818181818182}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.045454545454545456, (0, 1): 0.7727272727272727, (0, 2): 0.18181818181818182}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 34.0 -> 35.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 34.0 -> 35.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 77.0}
in get_filtered_urn(filter=1) --- total: total=79.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.012658227848101266, (1, 1): 0.012658227848101266, (1, 2): 0.9746835443037974}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.012658227848101266, (1, 1): 0.012658227848101266, (1, 2): 0.9746835443037974}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 77.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=79.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.012658227848101266, (2, 1): 0.9746835443037974, (2, 2): 0.012658227848101266}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.012658227848101266, (2, 1): 0.9746835443037974, (2, 2): 0.012658227848101266}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 77.0 -> 78.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 77.0 -> 78.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 39.0}
in get_filtered_urn(filter=0) --- total: total=51.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0392156862745098, (0, 1): 0.19607843137254902, (0, 2): 0.7647058823529411}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0392156862745098, (0, 1): 0.19607843137254902, (0, 2): 0.7647058823529411}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 39.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=45.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8666666666666667, (2, 1): 0.08888888888888889, (2, 2): 0.044444444444444446}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.8666666666666667, (2, 1): 0.08888888888888889, (2, 2): 0.044444444444444446}
in decode_message(signal=2) Receiver 5 got option: (2, 2) and decoded action: 2
Receiver 5 received signals: [2] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 2): 39.0 -> 39.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 78.0}
in get_filtered_urn(filter=1) --- total: total=80.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0125, (1, 1): 0.0125, (1, 2): 0.975}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0125, (1, 1): 0.0125, (1, 2): 0.975}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 78.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=80.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0125, (2, 1): 0.975, (2, 2): 0.0125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0125, (2, 1): 0.975, (2, 2): 0.0125}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 78.0 -> 79.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 78.0 -> 79.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 39.0}
in get_filtered_urn(filter=0) --- total: total=51.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0392156862745098, (0, 1): 0.19607843137254902, (0, 2): 0.7647058823529411}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0392156862745098, (0, 1): 0.19607843137254902, (0, 2): 0.7647058823529411}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 39.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=45.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8666666666666667, (2, 1): 0.08888888888888889, (2, 2): 0.044444444444444446}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8666666666666667, (2, 1): 0.08888888888888889, (2, 2): 0.044444444444444446}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 39.0 -> 40.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 39.0 -> 40.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 79.0}
in get_filtered_urn(filter=1) --- total: total=81.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.012345679012345678, (1, 1): 0.012345679012345678, (1, 2): 0.9753086419753086}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.012345679012345678, (1, 1): 0.012345679012345678, (1, 2): 0.9753086419753086}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 79.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=81.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.012345679012345678, (2, 1): 0.9753086419753086, (2, 2): 0.012345679012345678}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.012345679012345678, (2, 1): 0.9753086419753086, (2, 2): 0.012345679012345678}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 79.0 -> 80.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 79.0 -> 80.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 35.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=41.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8536585365853658, (1, 1): 0.04878048780487805, (1, 2): 0.0975609756097561}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8536585365853658, (1, 1): 0.04878048780487805, (1, 2): 0.0975609756097561}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 35.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=45.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.044444444444444446, (0, 1): 0.7777777777777778, (0, 2): 0.17777777777777778}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.044444444444444446, (0, 1): 0.7777777777777778, (0, 2): 0.17777777777777778}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 35.0 -> 35.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 8.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 62.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=64.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015625, (0, 1): 0.96875, (0, 2): 0.015625}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.015625, (0, 1): 0.96875, (0, 2): 0.015625}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 62.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=67.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9253731343283582, (1, 1): 0.014925373134328358, (1, 2): 0.05970149253731343}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9253731343283582, (1, 1): 0.014925373134328358, (1, 2): 0.05970149253731343}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 62.0 -> 63.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 62.0 -> 63.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 35.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=41.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8536585365853658, (1, 1): 0.04878048780487805, (1, 2): 0.0975609756097561}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8536585365853658, (1, 1): 0.04878048780487805, (1, 2): 0.0975609756097561}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 35.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=45.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.044444444444444446, (0, 1): 0.7777777777777778, (0, 2): 0.17777777777777778}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.044444444444444446, (0, 1): 0.7777777777777778, (0, 2): 0.17777777777777778}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 35.0 -> 35.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 8.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 50.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=55.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9090909090909091, (2, 1): 0.07272727272727272, (2, 2): 0.01818181818181818}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9090909090909091, (2, 1): 0.07272727272727272, (2, 2): 0.01818181818181818}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 50.0}
in get_filtered_urn(filter=0) --- total: total=52.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.019230769230769232, (0, 1): 0.019230769230769232, (0, 2): 0.9615384615384616}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.019230769230769232, (0, 1): 0.019230769230769232, (0, 2): 0.9615384615384616}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 50.0 -> 51.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 50.0 -> 51.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 24.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=34.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.23529411764705882, (2, 1): 0.7058823529411765, (2, 2): 0.058823529411764705}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.23529411764705882, (2, 1): 0.7058823529411765, (2, 2): 0.058823529411764705}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 24.0}
in get_filtered_urn(filter=1) --- total: total=36.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.2777777777777778, (1, 1): 0.05555555555555555, (1, 2): 0.6666666666666666}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.2777777777777778, (1, 1): 0.05555555555555555, (1, 2): 0.6666666666666666}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 24.0 -> 25.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 24.0 -> 25.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 80.0}
in get_filtered_urn(filter=1) --- total: total=82.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.012195121951219513, (1, 1): 0.012195121951219513, (1, 2): 0.975609756097561}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.012195121951219513, (1, 1): 0.012195121951219513, (1, 2): 0.975609756097561}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 80.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=82.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.012195121951219513, (2, 1): 0.975609756097561, (2, 2): 0.012195121951219513}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.012195121951219513, (2, 1): 0.975609756097561, (2, 2): 0.012195121951219513}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 80.0 -> 81.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 80.0 -> 81.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 25.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=35.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.22857142857142856, (2, 1): 0.7142857142857143, (2, 2): 0.05714285714285714}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.22857142857142856, (2, 1): 0.7142857142857143, (2, 2): 0.05714285714285714}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 25.0}
in get_filtered_urn(filter=1) --- total: total=37.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.2702702702702703, (1, 1): 0.05405405405405406, (1, 2): 0.6756756756756757}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.2702702702702703, (1, 1): 0.05405405405405406, (1, 2): 0.6756756756756757}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 25.0 -> 25.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 63.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=65.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015384615384615385, (0, 1): 0.9692307692307692, (0, 2): 0.015384615384615385}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.015384615384615385, (0, 1): 0.9692307692307692, (0, 2): 0.015384615384615385}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 63.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=68.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9264705882352942, (1, 1): 0.014705882352941176, (1, 2): 0.058823529411764705}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9264705882352942, (1, 1): 0.014705882352941176, (1, 2): 0.058823529411764705}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 63.0 -> 64.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 63.0 -> 64.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 35.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=41.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8536585365853658, (1, 1): 0.04878048780487805, (1, 2): 0.0975609756097561}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8536585365853658, (1, 1): 0.04878048780487805, (1, 2): 0.0975609756097561}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 35.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=45.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.044444444444444446, (0, 1): 0.7777777777777778, (0, 2): 0.17777777777777778}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.044444444444444446, (0, 1): 0.7777777777777778, (0, 2): 0.17777777777777778}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 35.0 -> 36.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 35.0 -> 36.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 81.0}
in get_filtered_urn(filter=1) --- total: total=83.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.012048192771084338, (1, 1): 0.012048192771084338, (1, 2): 0.9759036144578314}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.012048192771084338, (1, 1): 0.012048192771084338, (1, 2): 0.9759036144578314}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 81.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=83.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.012048192771084338, (2, 1): 0.9759036144578314, (2, 2): 0.012048192771084338}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.012048192771084338, (2, 1): 0.9759036144578314, (2, 2): 0.012048192771084338}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 81.0 -> 82.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 81.0 -> 82.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 36.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=42.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8571428571428571, (1, 1): 0.047619047619047616, (1, 2): 0.09523809523809523}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.8571428571428571, (1, 1): 0.047619047619047616, (1, 2): 0.09523809523809523}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 40.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=46.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8695652173913043, (2, 1): 0.08695652173913043, (2, 2): 0.043478260869565216}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8695652173913043, (2, 1): 0.08695652173913043, (2, 2): 0.043478260869565216}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 40.0 -> 40.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 64.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=66.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015151515151515152, (0, 1): 0.9696969696969697, (0, 2): 0.015151515151515152}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.015151515151515152, (0, 1): 0.9696969696969697, (0, 2): 0.015151515151515152}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 64.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=69.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.927536231884058, (1, 1): 0.014492753623188406, (1, 2): 0.057971014492753624}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.927536231884058, (1, 1): 0.014492753623188406, (1, 2): 0.057971014492753624}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 64.0 -> 65.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 64.0 -> 65.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 25.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=35.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.22857142857142856, (2, 1): 0.7142857142857143, (2, 2): 0.05714285714285714}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.22857142857142856, (2, 1): 0.7142857142857143, (2, 2): 0.05714285714285714}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 25.0}
in get_filtered_urn(filter=1) --- total: total=37.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.2702702702702703, (1, 1): 0.05405405405405406, (1, 2): 0.6756756756756757}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.2702702702702703, (1, 1): 0.05405405405405406, (1, 2): 0.6756756756756757}
in decode_message(signal=1) Receiver 5 got option: (1, 1) and decoded action: 1
Receiver 5 received signals: [1] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 25.0 -> 25.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 1): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 51.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=56.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9107142857142857, (2, 1): 0.07142857142857142, (2, 2): 0.017857142857142856}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9107142857142857, (2, 1): 0.07142857142857142, (2, 2): 0.017857142857142856}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 51.0}
in get_filtered_urn(filter=0) --- total: total=53.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.018867924528301886, (0, 1): 0.018867924528301886, (0, 2): 0.9622641509433962}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.018867924528301886, (0, 1): 0.018867924528301886, (0, 2): 0.9622641509433962}
in decode_message(signal=0) Receiver 2 got option: (0, 0) and decoded action: 0
Receiver 2 received signals: [0] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 0): 51.0 -> 51.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 0): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 25.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=35.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.22857142857142856, (2, 1): 0.7142857142857143, (2, 2): 0.05714285714285714}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.22857142857142856, (2, 1): 0.7142857142857143, (2, 2): 0.05714285714285714}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 36.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=46.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.043478260869565216, (0, 1): 0.782608695652174, (0, 2): 0.17391304347826086}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.043478260869565216, (0, 1): 0.782608695652174, (0, 2): 0.17391304347826086}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 8.0 -> 8.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 36.0 -> 36.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 82.0}
in get_filtered_urn(filter=1) --- total: total=84.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.011904761904761904, (1, 1): 0.011904761904761904, (1, 2): 0.9761904761904762}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.011904761904761904, (1, 1): 0.011904761904761904, (1, 2): 0.9761904761904762}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 82.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=84.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.011904761904761904, (2, 1): 0.9761904761904762, (2, 2): 0.011904761904761904}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.011904761904761904, (2, 1): 0.9761904761904762, (2, 2): 0.011904761904761904}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 82.0 -> 83.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 82.0 -> 83.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 40.0}
in get_filtered_urn(filter=0) --- total: total=52.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.038461538461538464, (0, 1): 0.19230769230769232, (0, 2): 0.7692307692307693}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.038461538461538464, (0, 1): 0.19230769230769232, (0, 2): 0.7692307692307693}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 40.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=46.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8695652173913043, (2, 1): 0.08695652173913043, (2, 2): 0.043478260869565216}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8695652173913043, (2, 1): 0.08695652173913043, (2, 2): 0.043478260869565216}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 40.0 -> 41.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 40.0 -> 41.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 51.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=56.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9107142857142857, (2, 1): 0.07142857142857142, (2, 2): 0.017857142857142856}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9107142857142857, (2, 1): 0.07142857142857142, (2, 2): 0.017857142857142856}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 51.0}
in get_filtered_urn(filter=0) --- total: total=53.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.018867924528301886, (0, 1): 0.018867924528301886, (0, 2): 0.9622641509433962}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.018867924528301886, (0, 1): 0.018867924528301886, (0, 2): 0.9622641509433962}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 51.0 -> 52.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 51.0 -> 52.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 36.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=42.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8571428571428571, (1, 1): 0.047619047619047616, (1, 2): 0.09523809523809523}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8571428571428571, (1, 1): 0.047619047619047616, (1, 2): 0.09523809523809523}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 36.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=46.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.043478260869565216, (0, 1): 0.782608695652174, (0, 2): 0.17391304347826086}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.043478260869565216, (0, 1): 0.782608695652174, (0, 2): 0.17391304347826086}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 36.0 -> 36.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 8.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 52.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=57.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9122807017543859, (2, 1): 0.07017543859649122, (2, 2): 0.017543859649122806}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9122807017543859, (2, 1): 0.07017543859649122, (2, 2): 0.017543859649122806}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 52.0}
in get_filtered_urn(filter=0) --- total: total=54.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.018518518518518517, (0, 1): 0.018518518518518517, (0, 2): 0.9629629629629629}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.018518518518518517, (0, 1): 0.018518518518518517, (0, 2): 0.9629629629629629}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 52.0 -> 53.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 52.0 -> 53.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 36.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=42.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8571428571428571, (1, 1): 0.047619047619047616, (1, 2): 0.09523809523809523}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8571428571428571, (1, 1): 0.047619047619047616, (1, 2): 0.09523809523809523}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 36.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=46.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.043478260869565216, (0, 1): 0.782608695652174, (0, 2): 0.17391304347826086}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.043478260869565216, (0, 1): 0.782608695652174, (0, 2): 0.17391304347826086}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 36.0 -> 37.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 36.0 -> 37.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 83.0}
in get_filtered_urn(filter=1) --- total: total=85.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.011764705882352941, (1, 1): 0.011764705882352941, (1, 2): 0.9764705882352941}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.011764705882352941, (1, 1): 0.011764705882352941, (1, 2): 0.9764705882352941}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 83.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=85.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.011764705882352941, (2, 1): 0.9764705882352941, (2, 2): 0.011764705882352941}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.011764705882352941, (2, 1): 0.9764705882352941, (2, 2): 0.011764705882352941}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 83.0 -> 84.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 83.0 -> 84.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 25.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=35.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.22857142857142856, (2, 1): 0.7142857142857143, (2, 2): 0.05714285714285714}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.22857142857142856, (2, 1): 0.7142857142857143, (2, 2): 0.05714285714285714}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 25.0}
in get_filtered_urn(filter=1) --- total: total=37.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.2702702702702703, (1, 1): 0.05405405405405406, (1, 2): 0.6756756756756757}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.2702702702702703, (1, 1): 0.05405405405405406, (1, 2): 0.6756756756756757}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 25.0 -> 26.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 25.0 -> 26.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 53.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=58.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9137931034482759, (2, 1): 0.06896551724137931, (2, 2): 0.017241379310344827}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9137931034482759, (2, 1): 0.06896551724137931, (2, 2): 0.017241379310344827}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 53.0}
in get_filtered_urn(filter=0) --- total: total=55.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01818181818181818, (0, 1): 0.01818181818181818, (0, 2): 0.9636363636363636}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.01818181818181818, (0, 1): 0.01818181818181818, (0, 2): 0.9636363636363636}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 53.0 -> 54.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 53.0 -> 54.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 37.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=43.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8604651162790697, (1, 1): 0.046511627906976744, (1, 2): 0.09302325581395349}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8604651162790697, (1, 1): 0.046511627906976744, (1, 2): 0.09302325581395349}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 37.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=47.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0425531914893617, (0, 1): 0.7872340425531915, (0, 2): 0.1702127659574468}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0425531914893617, (0, 1): 0.7872340425531915, (0, 2): 0.1702127659574468}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 37.0 -> 38.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 37.0 -> 38.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 54.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=59.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9152542372881356, (2, 1): 0.06779661016949153, (2, 2): 0.01694915254237288}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9152542372881356, (2, 1): 0.06779661016949153, (2, 2): 0.01694915254237288}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 54.0}
in get_filtered_urn(filter=0) --- total: total=56.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.017857142857142856, (0, 1): 0.017857142857142856, (0, 2): 0.9642857142857143}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.017857142857142856, (0, 1): 0.017857142857142856, (0, 2): 0.9642857142857143}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 54.0 -> 55.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 54.0 -> 55.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 26.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=36.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.2222222222222222, (2, 1): 0.7222222222222222, (2, 2): 0.05555555555555555}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.2222222222222222, (2, 1): 0.7222222222222222, (2, 2): 0.05555555555555555}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 41.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=47.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8723404255319149, (2, 1): 0.0851063829787234, (2, 2): 0.0425531914893617}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8723404255319149, (2, 1): 0.0851063829787234, (2, 2): 0.0425531914893617}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 41.0 -> 41.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 55.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=60.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9166666666666666, (2, 1): 0.06666666666666667, (2, 2): 0.016666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9166666666666666, (2, 1): 0.06666666666666667, (2, 2): 0.016666666666666666}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 55.0}
in get_filtered_urn(filter=0) --- total: total=57.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.017543859649122806, (0, 1): 0.017543859649122806, (0, 2): 0.9649122807017544}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.017543859649122806, (0, 1): 0.017543859649122806, (0, 2): 0.9649122807017544}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 55.0 -> 56.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 55.0 -> 56.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 41.0}
in get_filtered_urn(filter=0) --- total: total=53.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03773584905660377, (0, 1): 0.18867924528301888, (0, 2): 0.7735849056603774}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.03773584905660377, (0, 1): 0.18867924528301888, (0, 2): 0.7735849056603774}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 41.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=47.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8723404255319149, (2, 1): 0.0851063829787234, (2, 2): 0.0425531914893617}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8723404255319149, (2, 1): 0.0851063829787234, (2, 2): 0.0425531914893617}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 41.0 -> 42.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 41.0 -> 42.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 84.0}
in get_filtered_urn(filter=1) --- total: total=86.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.011627906976744186, (1, 1): 0.011627906976744186, (1, 2): 0.9767441860465116}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.011627906976744186, (1, 1): 0.011627906976744186, (1, 2): 0.9767441860465116}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 84.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=86.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.011627906976744186, (2, 1): 0.9767441860465116, (2, 2): 0.011627906976744186}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.011627906976744186, (2, 1): 0.9767441860465116, (2, 2): 0.011627906976744186}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 84.0 -> 85.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 84.0 -> 85.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 26.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=36.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.2222222222222222, (2, 1): 0.7222222222222222, (2, 2): 0.05555555555555555}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.2222222222222222, (2, 1): 0.7222222222222222, (2, 2): 0.05555555555555555}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 26.0}
in get_filtered_urn(filter=1) --- total: total=38.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.2631578947368421, (1, 1): 0.05263157894736842, (1, 2): 0.6842105263157895}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.2631578947368421, (1, 1): 0.05263157894736842, (1, 2): 0.6842105263157895}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 26.0 -> 27.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 26.0 -> 27.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 85.0}
in get_filtered_urn(filter=1) --- total: total=87.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.011494252873563218, (1, 1): 0.011494252873563218, (1, 2): 0.9770114942528736}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.011494252873563218, (1, 1): 0.011494252873563218, (1, 2): 0.9770114942528736}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 85.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=87.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.011494252873563218, (2, 1): 0.9770114942528736, (2, 2): 0.011494252873563218}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.011494252873563218, (2, 1): 0.9770114942528736, (2, 2): 0.011494252873563218}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 85.0 -> 86.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 85.0 -> 86.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 38.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=44.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8636363636363636, (1, 1): 0.045454545454545456, (1, 2): 0.09090909090909091}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8636363636363636, (1, 1): 0.045454545454545456, (1, 2): 0.09090909090909091}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 38.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=48.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.041666666666666664, (0, 1): 0.7916666666666666, (0, 2): 0.16666666666666666}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.041666666666666664, (0, 1): 0.7916666666666666, (0, 2): 0.16666666666666666}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 38.0 -> 39.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 38.0 -> 39.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 56.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=61.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9180327868852459, (2, 1): 0.06557377049180328, (2, 2): 0.01639344262295082}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9180327868852459, (2, 1): 0.06557377049180328, (2, 2): 0.01639344262295082}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 56.0}
in get_filtered_urn(filter=0) --- total: total=58.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.017241379310344827, (0, 1): 0.017241379310344827, (0, 2): 0.9655172413793104}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.017241379310344827, (0, 1): 0.017241379310344827, (0, 2): 0.9655172413793104}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 56.0 -> 57.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 56.0 -> 57.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 27.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=37.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.21621621621621623, (2, 1): 0.7297297297297297, (2, 2): 0.05405405405405406}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.21621621621621623, (2, 1): 0.7297297297297297, (2, 2): 0.05405405405405406}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 27.0}
in get_filtered_urn(filter=1) --- total: total=39.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.2564102564102564, (1, 1): 0.05128205128205128, (1, 2): 0.6923076923076923}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.2564102564102564, (1, 1): 0.05128205128205128, (1, 2): 0.6923076923076923}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 27.0 -> 28.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 27.0 -> 28.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 65.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=67.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014925373134328358, (0, 1): 0.9701492537313433, (0, 2): 0.014925373134328358}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.014925373134328358, (0, 1): 0.9701492537313433, (0, 2): 0.014925373134328358}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 65.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=70.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9285714285714286, (1, 1): 0.014285714285714285, (1, 2): 0.05714285714285714}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9285714285714286, (1, 1): 0.014285714285714285, (1, 2): 0.05714285714285714}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 65.0 -> 66.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 65.0 -> 66.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 39.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=45.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8666666666666667, (1, 1): 0.044444444444444446, (1, 2): 0.08888888888888889}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8666666666666667, (1, 1): 0.044444444444444446, (1, 2): 0.08888888888888889}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 39.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=49.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.04081632653061224, (0, 1): 0.7959183673469388, (0, 2): 0.16326530612244897}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.04081632653061224, (0, 1): 0.7959183673469388, (0, 2): 0.16326530612244897}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 39.0 -> 40.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 39.0 -> 40.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 86.0}
in get_filtered_urn(filter=1) --- total: total=88.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.011363636363636364, (1, 1): 0.011363636363636364, (1, 2): 0.9772727272727273}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.011363636363636364, (1, 1): 0.011363636363636364, (1, 2): 0.9772727272727273}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 86.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=88.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.011363636363636364, (2, 1): 0.9772727272727273, (2, 2): 0.011363636363636364}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.011363636363636364, (2, 1): 0.9772727272727273, (2, 2): 0.011363636363636364}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 86.0 -> 87.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 86.0 -> 87.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 40.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=46.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8695652173913043, (1, 1): 0.043478260869565216, (1, 2): 0.08695652173913043}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8695652173913043, (1, 1): 0.043478260869565216, (1, 2): 0.08695652173913043}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 40.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=50.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.04, (0, 1): 0.8, (0, 2): 0.16}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.04, (0, 1): 0.8, (0, 2): 0.16}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 40.0 -> 41.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 40.0 -> 41.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 57.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=62.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9193548387096774, (2, 1): 0.06451612903225806, (2, 2): 0.016129032258064516}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9193548387096774, (2, 1): 0.06451612903225806, (2, 2): 0.016129032258064516}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 57.0}
in get_filtered_urn(filter=0) --- total: total=59.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01694915254237288, (0, 1): 0.01694915254237288, (0, 2): 0.9661016949152542}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.01694915254237288, (0, 1): 0.01694915254237288, (0, 2): 0.9661016949152542}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 57.0 -> 58.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 57.0 -> 58.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 28.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=38.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.21052631578947367, (2, 1): 0.7368421052631579, (2, 2): 0.05263157894736842}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.21052631578947367, (2, 1): 0.7368421052631579, (2, 2): 0.05263157894736842}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 42.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=48.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.875, (2, 1): 0.08333333333333333, (2, 2): 0.041666666666666664}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.875, (2, 1): 0.08333333333333333, (2, 2): 0.041666666666666664}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 42.0 -> 42.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 66.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=68.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014705882352941176, (0, 1): 0.9705882352941176, (0, 2): 0.014705882352941176}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.014705882352941176, (0, 1): 0.9705882352941176, (0, 2): 0.014705882352941176}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 66.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=71.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9295774647887324, (1, 1): 0.014084507042253521, (1, 2): 0.056338028169014086}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9295774647887324, (1, 1): 0.014084507042253521, (1, 2): 0.056338028169014086}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 66.0 -> 67.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 66.0 -> 67.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 42.0}
in get_filtered_urn(filter=0) --- total: total=54.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.037037037037037035, (0, 1): 0.18518518518518517, (0, 2): 0.7777777777777778}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.037037037037037035, (0, 1): 0.18518518518518517, (0, 2): 0.7777777777777778}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 42.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=48.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.875, (2, 1): 0.08333333333333333, (2, 2): 0.041666666666666664}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.875, (2, 1): 0.08333333333333333, (2, 2): 0.041666666666666664}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 42.0 -> 43.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 42.0 -> 43.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 87.0}
in get_filtered_urn(filter=1) --- total: total=89.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.011235955056179775, (1, 1): 0.011235955056179775, (1, 2): 0.9775280898876404}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.011235955056179775, (1, 1): 0.011235955056179775, (1, 2): 0.9775280898876404}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 87.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=89.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.011235955056179775, (2, 1): 0.9775280898876404, (2, 2): 0.011235955056179775}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.011235955056179775, (2, 1): 0.9775280898876404, (2, 2): 0.011235955056179775}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 87.0 -> 88.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 87.0 -> 88.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 28.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=38.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.21052631578947367, (2, 1): 0.7368421052631579, (2, 2): 0.05263157894736842}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.21052631578947367, (2, 1): 0.7368421052631579, (2, 2): 0.05263157894736842}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 28.0}
in get_filtered_urn(filter=1) --- total: total=40.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.25, (1, 1): 0.05, (1, 2): 0.7}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.25, (1, 1): 0.05, (1, 2): 0.7}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 28.0 -> 29.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 28.0 -> 29.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 58.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=63.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9206349206349206, (2, 1): 0.06349206349206349, (2, 2): 0.015873015873015872}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9206349206349206, (2, 1): 0.06349206349206349, (2, 2): 0.015873015873015872}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 58.0}
in get_filtered_urn(filter=0) --- total: total=60.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.016666666666666666, (0, 1): 0.016666666666666666, (0, 2): 0.9666666666666667}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.016666666666666666, (0, 1): 0.016666666666666666, (0, 2): 0.9666666666666667}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 58.0 -> 59.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 58.0 -> 59.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 41.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=47.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8723404255319149, (1, 1): 0.0425531914893617, (1, 2): 0.0851063829787234}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8723404255319149, (1, 1): 0.0425531914893617, (1, 2): 0.0851063829787234}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 41.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=51.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0392156862745098, (0, 1): 0.803921568627451, (0, 2): 0.1568627450980392}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0392156862745098, (0, 1): 0.803921568627451, (0, 2): 0.1568627450980392}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 41.0 -> 42.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 41.0 -> 42.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 88.0}
in get_filtered_urn(filter=1) --- total: total=90.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.011111111111111112, (1, 1): 0.011111111111111112, (1, 2): 0.9777777777777777}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.011111111111111112, (1, 1): 0.011111111111111112, (1, 2): 0.9777777777777777}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 88.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=90.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.011111111111111112, (2, 1): 0.9777777777777777, (2, 2): 0.011111111111111112}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.011111111111111112, (2, 1): 0.9777777777777777, (2, 2): 0.011111111111111112}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 88.0 -> 89.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 88.0 -> 89.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 42.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=48.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.875, (1, 1): 0.041666666666666664, (1, 2): 0.08333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.875, (1, 1): 0.041666666666666664, (1, 2): 0.08333333333333333}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 43.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=49.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8775510204081632, (2, 1): 0.08163265306122448, (2, 2): 0.04081632653061224}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8775510204081632, (2, 1): 0.08163265306122448, (2, 2): 0.04081632653061224}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 43.0 -> 43.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 89.0}
in get_filtered_urn(filter=1) --- total: total=91.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.01098901098901099, (1, 1): 0.01098901098901099, (1, 2): 0.978021978021978}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.01098901098901099, (1, 1): 0.01098901098901099, (1, 2): 0.978021978021978}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 89.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=91.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.01098901098901099, (2, 1): 0.978021978021978, (2, 2): 0.01098901098901099}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.01098901098901099, (2, 1): 0.978021978021978, (2, 2): 0.01098901098901099}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 89.0 -> 90.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 89.0 -> 90.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 29.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=39.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.20512820512820512, (2, 1): 0.7435897435897436, (2, 2): 0.05128205128205128}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.20512820512820512, (2, 1): 0.7435897435897436, (2, 2): 0.05128205128205128}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 29.0}
in get_filtered_urn(filter=1) --- total: total=41.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.24390243902439024, (1, 1): 0.04878048780487805, (1, 2): 0.7073170731707317}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.24390243902439024, (1, 1): 0.04878048780487805, (1, 2): 0.7073170731707317}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 29.0 -> 30.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 29.0 -> 30.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 67.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=69.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014492753623188406, (0, 1): 0.9710144927536232, (0, 2): 0.014492753623188406}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.014492753623188406, (0, 1): 0.9710144927536232, (0, 2): 0.014492753623188406}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 67.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=72.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9305555555555556, (1, 1): 0.013888888888888888, (1, 2): 0.05555555555555555}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9305555555555556, (1, 1): 0.013888888888888888, (1, 2): 0.05555555555555555}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 67.0 -> 68.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 67.0 -> 68.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 42.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=48.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.875, (1, 1): 0.041666666666666664, (1, 2): 0.08333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.875, (1, 1): 0.041666666666666664, (1, 2): 0.08333333333333333}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 43.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=49.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8775510204081632, (2, 1): 0.08163265306122448, (2, 2): 0.04081632653061224}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8775510204081632, (2, 1): 0.08163265306122448, (2, 2): 0.04081632653061224}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 43.0 -> 43.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 59.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=64.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.921875, (2, 1): 0.0625, (2, 2): 0.015625}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.921875, (2, 1): 0.0625, (2, 2): 0.015625}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 59.0}
in get_filtered_urn(filter=0) --- total: total=61.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01639344262295082, (0, 1): 0.01639344262295082, (0, 2): 0.9672131147540983}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.01639344262295082, (0, 1): 0.01639344262295082, (0, 2): 0.9672131147540983}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 59.0 -> 60.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 59.0 -> 60.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 43.0}
in get_filtered_urn(filter=0) --- total: total=55.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03636363636363636, (0, 1): 0.18181818181818182, (0, 2): 0.7818181818181819}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.03636363636363636, (0, 1): 0.18181818181818182, (0, 2): 0.7818181818181819}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 43.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=49.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8775510204081632, (2, 1): 0.08163265306122448, (2, 2): 0.04081632653061224}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8775510204081632, (2, 1): 0.08163265306122448, (2, 2): 0.04081632653061224}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 43.0 -> 44.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 43.0 -> 44.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 60.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=65.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9230769230769231, (2, 1): 0.06153846153846154, (2, 2): 0.015384615384615385}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9230769230769231, (2, 1): 0.06153846153846154, (2, 2): 0.015384615384615385}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 60.0}
in get_filtered_urn(filter=0) --- total: total=62.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.016129032258064516, (0, 1): 0.016129032258064516, (0, 2): 0.967741935483871}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.016129032258064516, (0, 1): 0.016129032258064516, (0, 2): 0.967741935483871}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 60.0 -> 61.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 60.0 -> 61.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 30.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=40.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.2, (2, 1): 0.75, (2, 2): 0.05}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.2, (2, 1): 0.75, (2, 2): 0.05}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 30.0}
in get_filtered_urn(filter=1) --- total: total=42.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.23809523809523808, (1, 1): 0.047619047619047616, (1, 2): 0.7142857142857143}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.23809523809523808, (1, 1): 0.047619047619047616, (1, 2): 0.7142857142857143}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 30.0 -> 31.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 30.0 -> 31.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 90.0}
in get_filtered_urn(filter=1) --- total: total=92.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.010869565217391304, (1, 1): 0.010869565217391304, (1, 2): 0.9782608695652174}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.010869565217391304, (1, 1): 0.010869565217391304, (1, 2): 0.9782608695652174}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 90.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=92.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.010869565217391304, (2, 1): 0.9782608695652174, (2, 2): 0.010869565217391304}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.010869565217391304, (2, 1): 0.9782608695652174, (2, 2): 0.010869565217391304}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 90.0 -> 91.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 90.0 -> 91.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 42.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=48.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.875, (1, 1): 0.041666666666666664, (1, 2): 0.08333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.875, (1, 1): 0.041666666666666664, (1, 2): 0.08333333333333333}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 42.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=52.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.038461538461538464, (0, 1): 0.8076923076923077, (0, 2): 0.15384615384615385}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.038461538461538464, (0, 1): 0.8076923076923077, (0, 2): 0.15384615384615385}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 42.0 -> 43.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 42.0 -> 43.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 68.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=70.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014285714285714285, (0, 1): 0.9714285714285714, (0, 2): 0.014285714285714285}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.014285714285714285, (0, 1): 0.9714285714285714, (0, 2): 0.014285714285714285}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 68.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=73.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9315068493150684, (1, 1): 0.0136986301369863, (1, 2): 0.0547945205479452}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9315068493150684, (1, 1): 0.0136986301369863, (1, 2): 0.0547945205479452}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 68.0 -> 69.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 68.0 -> 69.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 43.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=49.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8775510204081632, (1, 1): 0.04081632653061224, (1, 2): 0.08163265306122448}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8775510204081632, (1, 1): 0.04081632653061224, (1, 2): 0.08163265306122448}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 43.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=53.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03773584905660377, (0, 1): 0.8113207547169812, (0, 2): 0.1509433962264151}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.03773584905660377, (0, 1): 0.8113207547169812, (0, 2): 0.1509433962264151}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 43.0 -> 44.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 43.0 -> 44.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 69.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=71.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014084507042253521, (0, 1): 0.971830985915493, (0, 2): 0.014084507042253521}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.014084507042253521, (0, 1): 0.971830985915493, (0, 2): 0.014084507042253521}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 69.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=74.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9324324324324325, (1, 1): 0.013513513513513514, (1, 2): 0.05405405405405406}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9324324324324325, (1, 1): 0.013513513513513514, (1, 2): 0.05405405405405406}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 69.0 -> 70.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 69.0 -> 70.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 44.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=50.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.88, (1, 1): 0.04, (1, 2): 0.08}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.88, (1, 1): 0.04, (1, 2): 0.08}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 44.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=54.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.037037037037037035, (0, 1): 0.8148148148148148, (0, 2): 0.14814814814814814}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.037037037037037035, (0, 1): 0.8148148148148148, (0, 2): 0.14814814814814814}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 44.0 -> 44.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 8.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 61.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=66.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9242424242424242, (2, 1): 0.06060606060606061, (2, 2): 0.015151515151515152}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9242424242424242, (2, 1): 0.06060606060606061, (2, 2): 0.015151515151515152}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 61.0}
in get_filtered_urn(filter=0) --- total: total=63.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015873015873015872, (0, 1): 0.015873015873015872, (0, 2): 0.9682539682539683}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.015873015873015872, (0, 1): 0.015873015873015872, (0, 2): 0.9682539682539683}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 61.0 -> 62.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 61.0 -> 62.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 44.0}
in get_filtered_urn(filter=0) --- total: total=56.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03571428571428571, (0, 1): 0.17857142857142858, (0, 2): 0.7857142857142857}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.03571428571428571, (0, 1): 0.17857142857142858, (0, 2): 0.7857142857142857}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 31.0}
in get_filtered_urn(filter=1) --- total: total=43.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.23255813953488372, (1, 1): 0.046511627906976744, (1, 2): 0.7209302325581395}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.23255813953488372, (1, 1): 0.046511627906976744, (1, 2): 0.7209302325581395}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 31.0 -> 31.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 91.0}
in get_filtered_urn(filter=1) --- total: total=93.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.010752688172043012, (1, 1): 0.010752688172043012, (1, 2): 0.978494623655914}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.010752688172043012, (1, 1): 0.010752688172043012, (1, 2): 0.978494623655914}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 91.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=93.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.010752688172043012, (2, 1): 0.978494623655914, (2, 2): 0.010752688172043012}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.010752688172043012, (2, 1): 0.978494623655914, (2, 2): 0.010752688172043012}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 91.0 -> 92.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 91.0 -> 92.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 31.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=41.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.1951219512195122, (2, 1): 0.7560975609756098, (2, 2): 0.04878048780487805}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.1951219512195122, (2, 1): 0.7560975609756098, (2, 2): 0.04878048780487805}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 31.0}
in get_filtered_urn(filter=1) --- total: total=43.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.23255813953488372, (1, 1): 0.046511627906976744, (1, 2): 0.7209302325581395}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.23255813953488372, (1, 1): 0.046511627906976744, (1, 2): 0.7209302325581395}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 31.0 -> 32.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 31.0 -> 32.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 92.0}
in get_filtered_urn(filter=1) --- total: total=94.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.010638297872340425, (1, 1): 0.010638297872340425, (1, 2): 0.9787234042553191}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.010638297872340425, (1, 1): 0.010638297872340425, (1, 2): 0.9787234042553191}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 92.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=94.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.010638297872340425, (2, 1): 0.9787234042553191, (2, 2): 0.010638297872340425}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.010638297872340425, (2, 1): 0.9787234042553191, (2, 2): 0.010638297872340425}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 92.0 -> 93.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 92.0 -> 93.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 44.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=50.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.88, (1, 1): 0.04, (1, 2): 0.08}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.88, (1, 1): 0.04, (1, 2): 0.08}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 44.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=54.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.037037037037037035, (0, 1): 0.8148148148148148, (0, 2): 0.14814814814814814}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.037037037037037035, (0, 1): 0.8148148148148148, (0, 2): 0.14814814814814814}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 44.0 -> 45.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 44.0 -> 45.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 93.0}
in get_filtered_urn(filter=1) --- total: total=95.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.010526315789473684, (1, 1): 0.010526315789473684, (1, 2): 0.9789473684210527}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.010526315789473684, (1, 1): 0.010526315789473684, (1, 2): 0.9789473684210527}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 93.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=95.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.010526315789473684, (2, 1): 0.9789473684210527, (2, 2): 0.010526315789473684}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.010526315789473684, (2, 1): 0.9789473684210527, (2, 2): 0.010526315789473684}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 93.0 -> 94.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 93.0 -> 94.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 45.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=51.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8823529411764706, (1, 1): 0.0392156862745098, (1, 2): 0.0784313725490196}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8823529411764706, (1, 1): 0.0392156862745098, (1, 2): 0.0784313725490196}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 45.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=55.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03636363636363636, (0, 1): 0.8181818181818182, (0, 2): 0.14545454545454545}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.03636363636363636, (0, 1): 0.8181818181818182, (0, 2): 0.14545454545454545}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 45.0 -> 46.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 45.0 -> 46.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 94.0}
in get_filtered_urn(filter=1) --- total: total=96.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.010416666666666666, (1, 1): 0.010416666666666666, (1, 2): 0.9791666666666666}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.010416666666666666, (1, 1): 0.010416666666666666, (1, 2): 0.9791666666666666}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 94.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=96.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.010416666666666666, (2, 1): 0.9791666666666666, (2, 2): 0.010416666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.010416666666666666, (2, 1): 0.9791666666666666, (2, 2): 0.010416666666666666}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 94.0 -> 95.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 94.0 -> 95.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 44.0}
in get_filtered_urn(filter=0) --- total: total=56.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03571428571428571, (0, 1): 0.17857142857142858, (0, 2): 0.7857142857142857}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.03571428571428571, (0, 1): 0.17857142857142858, (0, 2): 0.7857142857142857}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 44.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=50.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.88, (2, 1): 0.08, (2, 2): 0.04}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.88, (2, 1): 0.08, (2, 2): 0.04}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 44.0 -> 45.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 44.0 -> 45.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 70.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=72.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013888888888888888, (0, 1): 0.9722222222222222, (0, 2): 0.013888888888888888}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.013888888888888888, (0, 1): 0.9722222222222222, (0, 2): 0.013888888888888888}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 70.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=75.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9333333333333333, (1, 1): 0.013333333333333334, (1, 2): 0.05333333333333334}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.9333333333333333, (1, 1): 0.013333333333333334, (1, 2): 0.05333333333333334}
in decode_message(signal=1) Receiver 2 got option: (1, 2) and decoded action: 2
Receiver 2 received signals: [1] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 1): 70.0 -> 70.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 45.0}
in get_filtered_urn(filter=0) --- total: total=57.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03508771929824561, (0, 1): 0.17543859649122806, (0, 2): 0.7894736842105263}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.03508771929824561, (0, 1): 0.17543859649122806, (0, 2): 0.7894736842105263}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 45.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=51.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8823529411764706, (2, 1): 0.0784313725490196, (2, 2): 0.0392156862745098}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8823529411764706, (2, 1): 0.0784313725490196, (2, 2): 0.0392156862745098}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 45.0 -> 46.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 45.0 -> 46.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 95.0}
in get_filtered_urn(filter=1) --- total: total=97.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.010309278350515464, (1, 1): 0.010309278350515464, (1, 2): 0.979381443298969}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.010309278350515464, (1, 1): 0.010309278350515464, (1, 2): 0.979381443298969}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 95.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=97.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.010309278350515464, (2, 1): 0.979381443298969, (2, 2): 0.010309278350515464}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.010309278350515464, (2, 1): 0.979381443298969, (2, 2): 0.010309278350515464}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 95.0 -> 96.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 95.0 -> 96.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 46.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=52.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8846153846153846, (1, 1): 0.038461538461538464, (1, 2): 0.07692307692307693}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8846153846153846, (1, 1): 0.038461538461538464, (1, 2): 0.07692307692307693}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 46.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=56.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03571428571428571, (0, 1): 0.8214285714285714, (0, 2): 0.14285714285714285}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.03571428571428571, (0, 1): 0.8214285714285714, (0, 2): 0.14285714285714285}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 46.0 -> 47.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 46.0 -> 47.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 96.0}
in get_filtered_urn(filter=1) --- total: total=98.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.01020408163265306, (1, 1): 0.01020408163265306, (1, 2): 0.9795918367346939}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.01020408163265306, (1, 1): 0.01020408163265306, (1, 2): 0.9795918367346939}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 96.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=98.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.01020408163265306, (2, 1): 0.9795918367346939, (2, 2): 0.01020408163265306}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.01020408163265306, (2, 1): 0.9795918367346939, (2, 2): 0.01020408163265306}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 96.0 -> 97.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 96.0 -> 97.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 32.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=42.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.19047619047619047, (2, 1): 0.7619047619047619, (2, 2): 0.047619047619047616}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.19047619047619047, (2, 1): 0.7619047619047619, (2, 2): 0.047619047619047616}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 32.0}
in get_filtered_urn(filter=1) --- total: total=44.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.22727272727272727, (1, 1): 0.045454545454545456, (1, 2): 0.7272727272727273}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.22727272727272727, (1, 1): 0.045454545454545456, (1, 2): 0.7272727272727273}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 32.0 -> 33.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 32.0 -> 33.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 70.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=72.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013888888888888888, (0, 1): 0.9722222222222222, (0, 2): 0.013888888888888888}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.013888888888888888, (0, 1): 0.9722222222222222, (0, 2): 0.013888888888888888}
Sender 1 got filter 0 choose option: (0, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 62.0}
in get_filtered_urn(filter=0) --- total: total=64.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015625, (0, 1): 0.015625, (0, 2): 0.96875}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.015625, (0, 1): 0.015625, (0, 2): 0.96875}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 0): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 2): 62.0 -> 62.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 47.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=53.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8867924528301887, (1, 1): 0.03773584905660377, (1, 2): 0.07547169811320754}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8867924528301887, (1, 1): 0.03773584905660377, (1, 2): 0.07547169811320754}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 47.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=57.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03508771929824561, (0, 1): 0.8245614035087719, (0, 2): 0.14035087719298245}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.03508771929824561, (0, 1): 0.8245614035087719, (0, 2): 0.14035087719298245}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 47.0 -> 48.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 47.0 -> 48.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 62.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=67.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9253731343283582, (2, 1): 0.05970149253731343, (2, 2): 0.014925373134328358}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9253731343283582, (2, 1): 0.05970149253731343, (2, 2): 0.014925373134328358}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 62.0}
in get_filtered_urn(filter=0) --- total: total=64.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015625, (0, 1): 0.015625, (0, 2): 0.96875}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.015625, (0, 1): 0.015625, (0, 2): 0.96875}
in decode_message(signal=0) Receiver 2 got option: (0, 0) and decoded action: 0
Receiver 2 received signals: [0] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 0): 62.0 -> 62.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 0): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 46.0}
in get_filtered_urn(filter=0) --- total: total=58.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.034482758620689655, (0, 1): 0.1724137931034483, (0, 2): 0.7931034482758621}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.034482758620689655, (0, 1): 0.1724137931034483, (0, 2): 0.7931034482758621}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 46.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=52.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8846153846153846, (2, 1): 0.07692307692307693, (2, 2): 0.038461538461538464}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8846153846153846, (2, 1): 0.07692307692307693, (2, 2): 0.038461538461538464}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 46.0 -> 47.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 46.0 -> 47.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 97.0}
in get_filtered_urn(filter=1) --- total: total=99.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.010101010101010102, (1, 1): 0.010101010101010102, (1, 2): 0.9797979797979798}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.010101010101010102, (1, 1): 0.010101010101010102, (1, 2): 0.9797979797979798}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 97.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=99.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.010101010101010102, (2, 1): 0.9797979797979798, (2, 2): 0.010101010101010102}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.010101010101010102, (2, 1): 0.9797979797979798, (2, 2): 0.010101010101010102}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 97.0 -> 98.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 97.0 -> 98.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 33.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=43.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.18604651162790697, (2, 1): 0.7674418604651163, (2, 2): 0.046511627906976744}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.18604651162790697, (2, 1): 0.7674418604651163, (2, 2): 0.046511627906976744}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 33.0}
in get_filtered_urn(filter=1) --- total: total=45.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.2222222222222222, (1, 1): 0.044444444444444446, (1, 2): 0.7333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.2222222222222222, (1, 1): 0.044444444444444446, (1, 2): 0.7333333333333333}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 33.0 -> 34.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 33.0 -> 34.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 70.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=72.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013888888888888888, (0, 1): 0.9722222222222222, (0, 2): 0.013888888888888888}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.013888888888888888, (0, 1): 0.9722222222222222, (0, 2): 0.013888888888888888}
Sender 1 got filter 0 choose option: (0, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 98.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=100.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.01, (2, 1): 0.98, (2, 2): 0.01}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.01, (2, 1): 0.98, (2, 2): 0.01}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 2): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 1): 98.0 -> 98.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 48.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=54.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8888888888888888, (1, 1): 0.037037037037037035, (1, 2): 0.07407407407407407}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8888888888888888, (1, 1): 0.037037037037037035, (1, 2): 0.07407407407407407}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 48.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=58.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.034482758620689655, (0, 1): 0.8275862068965517, (0, 2): 0.13793103448275862}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.034482758620689655, (0, 1): 0.8275862068965517, (0, 2): 0.13793103448275862}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 48.0 -> 49.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 48.0 -> 49.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 70.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=72.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013888888888888888, (0, 1): 0.9722222222222222, (0, 2): 0.013888888888888888}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.013888888888888888, (0, 1): 0.9722222222222222, (0, 2): 0.013888888888888888}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 70.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=75.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9333333333333333, (1, 1): 0.013333333333333334, (1, 2): 0.05333333333333334}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9333333333333333, (1, 1): 0.013333333333333334, (1, 2): 0.05333333333333334}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 70.0 -> 71.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 70.0 -> 71.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 34.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=44.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.18181818181818182, (2, 1): 0.7727272727272727, (2, 2): 0.045454545454545456}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.18181818181818182, (2, 1): 0.7727272727272727, (2, 2): 0.045454545454545456}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 34.0}
in get_filtered_urn(filter=1) --- total: total=46.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.21739130434782608, (1, 1): 0.043478260869565216, (1, 2): 0.7391304347826086}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.21739130434782608, (1, 1): 0.043478260869565216, (1, 2): 0.7391304347826086}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 34.0 -> 35.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 34.0 -> 35.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 71.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=73.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0136986301369863, (0, 1): 0.9726027397260274, (0, 2): 0.0136986301369863}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0136986301369863, (0, 1): 0.9726027397260274, (0, 2): 0.0136986301369863}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 71.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=76.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9342105263157895, (1, 1): 0.013157894736842105, (1, 2): 0.05263157894736842}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9342105263157895, (1, 1): 0.013157894736842105, (1, 2): 0.05263157894736842}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 71.0 -> 72.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 71.0 -> 72.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 35.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=45.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.17777777777777778, (2, 1): 0.7777777777777778, (2, 2): 0.044444444444444446}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.17777777777777778, (2, 1): 0.7777777777777778, (2, 2): 0.044444444444444446}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 35.0}
in get_filtered_urn(filter=1) --- total: total=47.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.2127659574468085, (1, 1): 0.0425531914893617, (1, 2): 0.7446808510638298}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.2127659574468085, (1, 1): 0.0425531914893617, (1, 2): 0.7446808510638298}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 35.0 -> 36.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 35.0 -> 36.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 98.0}
in get_filtered_urn(filter=1) --- total: total=100.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.01, (1, 1): 0.01, (1, 2): 0.98}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.01, (1, 1): 0.01, (1, 2): 0.98}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 98.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=100.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.01, (2, 1): 0.98, (2, 2): 0.01}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.01, (2, 1): 0.98, (2, 2): 0.01}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 98.0 -> 99.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 98.0 -> 99.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 49.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=55.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8909090909090909, (1, 1): 0.03636363636363636, (1, 2): 0.07272727272727272}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8909090909090909, (1, 1): 0.03636363636363636, (1, 2): 0.07272727272727272}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 49.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=59.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03389830508474576, (0, 1): 0.8305084745762712, (0, 2): 0.13559322033898305}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.03389830508474576, (0, 1): 0.8305084745762712, (0, 2): 0.13559322033898305}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 49.0 -> 50.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 49.0 -> 50.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 72.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=74.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013513513513513514, (0, 1): 0.972972972972973, (0, 2): 0.013513513513513514}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.013513513513513514, (0, 1): 0.972972972972973, (0, 2): 0.013513513513513514}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 72.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=77.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.935064935064935, (1, 1): 0.012987012987012988, (1, 2): 0.05194805194805195}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.935064935064935, (1, 1): 0.012987012987012988, (1, 2): 0.05194805194805195}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 72.0 -> 73.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 72.0 -> 73.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 50.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=56.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8928571428571429, (1, 1): 0.03571428571428571, (1, 2): 0.07142857142857142}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8928571428571429, (1, 1): 0.03571428571428571, (1, 2): 0.07142857142857142}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 50.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=60.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03333333333333333, (0, 1): 0.8333333333333334, (0, 2): 0.13333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.03333333333333333, (0, 1): 0.8333333333333334, (0, 2): 0.13333333333333333}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 50.0 -> 50.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 8.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 62.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=67.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9253731343283582, (2, 1): 0.05970149253731343, (2, 2): 0.014925373134328358}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9253731343283582, (2, 1): 0.05970149253731343, (2, 2): 0.014925373134328358}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 62.0}
in get_filtered_urn(filter=0) --- total: total=64.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015625, (0, 1): 0.015625, (0, 2): 0.96875}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.015625, (0, 1): 0.015625, (0, 2): 0.96875}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 62.0 -> 63.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 62.0 -> 63.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 50.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=56.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8928571428571429, (1, 1): 0.03571428571428571, (1, 2): 0.07142857142857142}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8928571428571429, (1, 1): 0.03571428571428571, (1, 2): 0.07142857142857142}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 50.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=60.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03333333333333333, (0, 1): 0.8333333333333334, (0, 2): 0.13333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.03333333333333333, (0, 1): 0.8333333333333334, (0, 2): 0.13333333333333333}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 50.0 -> 51.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 50.0 -> 51.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 73.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=75.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013333333333333334, (0, 1): 0.9733333333333334, (0, 2): 0.013333333333333334}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.013333333333333334, (0, 1): 0.9733333333333334, (0, 2): 0.013333333333333334}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 73.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=78.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9358974358974359, (1, 1): 0.01282051282051282, (1, 2): 0.05128205128205128}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9358974358974359, (1, 1): 0.01282051282051282, (1, 2): 0.05128205128205128}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 73.0 -> 74.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 73.0 -> 74.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 47.0}
in get_filtered_urn(filter=0) --- total: total=59.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03389830508474576, (0, 1): 0.1694915254237288, (0, 2): 0.7966101694915254}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.03389830508474576, (0, 1): 0.1694915254237288, (0, 2): 0.7966101694915254}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 47.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=53.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8867924528301887, (2, 1): 0.07547169811320754, (2, 2): 0.03773584905660377}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8867924528301887, (2, 1): 0.07547169811320754, (2, 2): 0.03773584905660377}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 47.0 -> 48.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 47.0 -> 48.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 99.0}
in get_filtered_urn(filter=1) --- total: total=101.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.009900990099009901, (1, 1): 0.009900990099009901, (1, 2): 0.9801980198019802}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.009900990099009901, (1, 1): 0.009900990099009901, (1, 2): 0.9801980198019802}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 99.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=101.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.009900990099009901, (2, 1): 0.9801980198019802, (2, 2): 0.009900990099009901}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.009900990099009901, (2, 1): 0.9801980198019802, (2, 2): 0.009900990099009901}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 99.0 -> 100.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 99.0 -> 100.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 36.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=46.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.17391304347826086, (2, 1): 0.782608695652174, (2, 2): 0.043478260869565216}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.17391304347826086, (2, 1): 0.782608695652174, (2, 2): 0.043478260869565216}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 36.0}
in get_filtered_urn(filter=1) --- total: total=48.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.20833333333333334, (1, 1): 0.041666666666666664, (1, 2): 0.75}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.20833333333333334, (1, 1): 0.041666666666666664, (1, 2): 0.75}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 36.0 -> 37.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 36.0 -> 37.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 100.0}
in get_filtered_urn(filter=1) --- total: total=102.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.00980392156862745, (1, 1): 0.00980392156862745, (1, 2): 0.9803921568627451}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.00980392156862745, (1, 1): 0.00980392156862745, (1, 2): 0.9803921568627451}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 100.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=102.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.00980392156862745, (2, 1): 0.9803921568627451, (2, 2): 0.00980392156862745}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.00980392156862745, (2, 1): 0.9803921568627451, (2, 2): 0.00980392156862745}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 100.0 -> 101.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 100.0 -> 101.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 37.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=47.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.1702127659574468, (2, 1): 0.7872340425531915, (2, 2): 0.0425531914893617}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.1702127659574468, (2, 1): 0.7872340425531915, (2, 2): 0.0425531914893617}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 37.0}
in get_filtered_urn(filter=1) --- total: total=49.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.20408163265306123, (1, 1): 0.04081632653061224, (1, 2): 0.7551020408163265}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.20408163265306123, (1, 1): 0.04081632653061224, (1, 2): 0.7551020408163265}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 37.0 -> 38.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 37.0 -> 38.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 74.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=76.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013157894736842105, (0, 1): 0.9736842105263158, (0, 2): 0.013157894736842105}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.013157894736842105, (0, 1): 0.9736842105263158, (0, 2): 0.013157894736842105}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 74.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=79.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9367088607594937, (1, 1): 0.012658227848101266, (1, 2): 0.05063291139240506}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.9367088607594937, (1, 1): 0.012658227848101266, (1, 2): 0.05063291139240506}
in decode_message(signal=1) Receiver 2 got option: (1, 2) and decoded action: 2
Receiver 2 received signals: [1] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 1): 74.0 -> 74.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 51.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=57.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8947368421052632, (1, 1): 0.03508771929824561, (1, 2): 0.07017543859649122}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8947368421052632, (1, 1): 0.03508771929824561, (1, 2): 0.07017543859649122}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 51.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=61.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03278688524590164, (0, 1): 0.8360655737704918, (0, 2): 0.13114754098360656}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.03278688524590164, (0, 1): 0.8360655737704918, (0, 2): 0.13114754098360656}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 51.0 -> 52.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 51.0 -> 52.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 101.0}
in get_filtered_urn(filter=1) --- total: total=103.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.009708737864077669, (1, 1): 0.009708737864077669, (1, 2): 0.9805825242718447}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.009708737864077669, (1, 1): 0.009708737864077669, (1, 2): 0.9805825242718447}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 101.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=103.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.009708737864077669, (2, 1): 0.9805825242718447, (2, 2): 0.009708737864077669}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.009708737864077669, (2, 1): 0.9805825242718447, (2, 2): 0.009708737864077669}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 101.0 -> 102.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 101.0 -> 102.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 38.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=48.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.16666666666666666, (2, 1): 0.7916666666666666, (2, 2): 0.041666666666666664}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.16666666666666666, (2, 1): 0.7916666666666666, (2, 2): 0.041666666666666664}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 38.0}
in get_filtered_urn(filter=1) --- total: total=50.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.2, (1, 1): 0.04, (1, 2): 0.76}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.2, (1, 1): 0.04, (1, 2): 0.76}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 38.0 -> 38.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 74.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=76.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013157894736842105, (0, 1): 0.9736842105263158, (0, 2): 0.013157894736842105}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.013157894736842105, (0, 1): 0.9736842105263158, (0, 2): 0.013157894736842105}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 74.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=79.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9367088607594937, (1, 1): 0.012658227848101266, (1, 2): 0.05063291139240506}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9367088607594937, (1, 1): 0.012658227848101266, (1, 2): 0.05063291139240506}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 74.0 -> 75.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 74.0 -> 75.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 48.0}
in get_filtered_urn(filter=0) --- total: total=60.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03333333333333333, (0, 1): 0.16666666666666666, (0, 2): 0.8}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.03333333333333333, (0, 1): 0.16666666666666666, (0, 2): 0.8}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 48.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=54.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8888888888888888, (2, 1): 0.07407407407407407, (2, 2): 0.037037037037037035}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8888888888888888, (2, 1): 0.07407407407407407, (2, 2): 0.037037037037037035}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 48.0 -> 49.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 48.0 -> 49.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 63.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=68.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9264705882352942, (2, 1): 0.058823529411764705, (2, 2): 0.014705882352941176}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9264705882352942, (2, 1): 0.058823529411764705, (2, 2): 0.014705882352941176}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 63.0}
in get_filtered_urn(filter=0) --- total: total=65.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015384615384615385, (0, 1): 0.015384615384615385, (0, 2): 0.9692307692307692}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.015384615384615385, (0, 1): 0.015384615384615385, (0, 2): 0.9692307692307692}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 63.0 -> 64.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 63.0 -> 64.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 38.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=48.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.16666666666666666, (2, 1): 0.7916666666666666, (2, 2): 0.041666666666666664}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.16666666666666666, (2, 1): 0.7916666666666666, (2, 2): 0.041666666666666664}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 38.0}
in get_filtered_urn(filter=1) --- total: total=50.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.2, (1, 1): 0.04, (1, 2): 0.76}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.2, (1, 1): 0.04, (1, 2): 0.76}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 38.0 -> 39.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 38.0 -> 39.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 102.0}
in get_filtered_urn(filter=1) --- total: total=104.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.009615384615384616, (1, 1): 0.009615384615384616, (1, 2): 0.9807692307692307}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.009615384615384616, (1, 1): 0.009615384615384616, (1, 2): 0.9807692307692307}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 102.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=104.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.009615384615384616, (2, 1): 0.9807692307692307, (2, 2): 0.009615384615384616}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.009615384615384616, (2, 1): 0.9807692307692307, (2, 2): 0.009615384615384616}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 102.0 -> 103.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 102.0 -> 103.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 52.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=58.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.896551724137931, (1, 1): 0.034482758620689655, (1, 2): 0.06896551724137931}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.896551724137931, (1, 1): 0.034482758620689655, (1, 2): 0.06896551724137931}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 52.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=62.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03225806451612903, (0, 1): 0.8387096774193549, (0, 2): 0.12903225806451613}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.03225806451612903, (0, 1): 0.8387096774193549, (0, 2): 0.12903225806451613}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 52.0 -> 53.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 52.0 -> 53.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 75.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=77.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012987012987012988, (0, 1): 0.974025974025974, (0, 2): 0.012987012987012988}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.012987012987012988, (0, 1): 0.974025974025974, (0, 2): 0.012987012987012988}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 75.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=80.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9375, (1, 1): 0.0125, (1, 2): 0.05}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9375, (1, 1): 0.0125, (1, 2): 0.05}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 75.0 -> 76.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 75.0 -> 76.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 39.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=49.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.16326530612244897, (2, 1): 0.7959183673469388, (2, 2): 0.04081632653061224}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.16326530612244897, (2, 1): 0.7959183673469388, (2, 2): 0.04081632653061224}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 39.0}
in get_filtered_urn(filter=1) --- total: total=51.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.19607843137254902, (1, 1): 0.0392156862745098, (1, 2): 0.7647058823529411}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.19607843137254902, (1, 1): 0.0392156862745098, (1, 2): 0.7647058823529411}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 39.0 -> 40.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 39.0 -> 40.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 76.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=78.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01282051282051282, (0, 1): 0.9743589743589743, (0, 2): 0.01282051282051282}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.01282051282051282, (0, 1): 0.9743589743589743, (0, 2): 0.01282051282051282}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 76.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=81.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9382716049382716, (1, 1): 0.012345679012345678, (1, 2): 0.04938271604938271}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9382716049382716, (1, 1): 0.012345679012345678, (1, 2): 0.04938271604938271}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 76.0 -> 77.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 76.0 -> 77.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 49.0}
in get_filtered_urn(filter=0) --- total: total=61.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03278688524590164, (0, 1): 0.16393442622950818, (0, 2): 0.8032786885245902}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.03278688524590164, (0, 1): 0.16393442622950818, (0, 2): 0.8032786885245902}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 49.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=55.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8909090909090909, (2, 1): 0.07272727272727272, (2, 2): 0.03636363636363636}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8909090909090909, (2, 1): 0.07272727272727272, (2, 2): 0.03636363636363636}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 49.0 -> 50.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 49.0 -> 50.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 103.0}
in get_filtered_urn(filter=1) --- total: total=105.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.009523809523809525, (1, 1): 0.009523809523809525, (1, 2): 0.9809523809523809}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.009523809523809525, (1, 1): 0.009523809523809525, (1, 2): 0.9809523809523809}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 103.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=105.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.009523809523809525, (2, 1): 0.9809523809523809, (2, 2): 0.009523809523809525}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.009523809523809525, (2, 1): 0.9809523809523809, (2, 2): 0.009523809523809525}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 103.0 -> 104.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 103.0 -> 104.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 40.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=50.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.16, (2, 1): 0.8, (2, 2): 0.04}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.16, (2, 1): 0.8, (2, 2): 0.04}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 40.0}
in get_filtered_urn(filter=1) --- total: total=52.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.19230769230769232, (1, 1): 0.038461538461538464, (1, 2): 0.7692307692307693}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.19230769230769232, (1, 1): 0.038461538461538464, (1, 2): 0.7692307692307693}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 40.0 -> 41.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 40.0 -> 41.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 104.0}
in get_filtered_urn(filter=1) --- total: total=106.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.009433962264150943, (1, 1): 0.009433962264150943, (1, 2): 0.9811320754716981}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.009433962264150943, (1, 1): 0.009433962264150943, (1, 2): 0.9811320754716981}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 104.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=106.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.009433962264150943, (2, 1): 0.9811320754716981, (2, 2): 0.009433962264150943}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.009433962264150943, (2, 1): 0.9811320754716981, (2, 2): 0.009433962264150943}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 104.0 -> 105.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 104.0 -> 105.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 50.0}
in get_filtered_urn(filter=0) --- total: total=62.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03225806451612903, (0, 1): 0.16129032258064516, (0, 2): 0.8064516129032258}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.03225806451612903, (0, 1): 0.16129032258064516, (0, 2): 0.8064516129032258}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 50.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=56.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8928571428571429, (2, 1): 0.07142857142857142, (2, 2): 0.03571428571428571}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8928571428571429, (2, 1): 0.07142857142857142, (2, 2): 0.03571428571428571}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 50.0 -> 51.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 50.0 -> 51.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 105.0}
in get_filtered_urn(filter=1) --- total: total=107.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.009345794392523364, (1, 1): 0.009345794392523364, (1, 2): 0.9813084112149533}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.009345794392523364, (1, 1): 0.009345794392523364, (1, 2): 0.9813084112149533}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 105.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=107.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.009345794392523364, (2, 1): 0.9813084112149533, (2, 2): 0.009345794392523364}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.009345794392523364, (2, 1): 0.9813084112149533, (2, 2): 0.009345794392523364}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 105.0 -> 106.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 105.0 -> 106.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 53.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=59.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.8983050847457628, (1, 1): 0.03389830508474576, (1, 2): 0.06779661016949153}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.8983050847457628, (1, 1): 0.03389830508474576, (1, 2): 0.06779661016949153}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 53.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=63.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.031746031746031744, (0, 1): 0.8412698412698413, (0, 2): 0.12698412698412698}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.031746031746031744, (0, 1): 0.8412698412698413, (0, 2): 0.12698412698412698}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 53.0 -> 54.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 53.0 -> 54.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 64.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=69.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.927536231884058, (2, 1): 0.057971014492753624, (2, 2): 0.014492753623188406}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.927536231884058, (2, 1): 0.057971014492753624, (2, 2): 0.014492753623188406}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 64.0}
in get_filtered_urn(filter=0) --- total: total=66.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015151515151515152, (0, 1): 0.015151515151515152, (0, 2): 0.9696969696969697}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.015151515151515152, (0, 1): 0.015151515151515152, (0, 2): 0.9696969696969697}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 64.0 -> 65.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 64.0 -> 65.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 54.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=60.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9, (1, 1): 0.03333333333333333, (1, 2): 0.06666666666666667}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.9, (1, 1): 0.03333333333333333, (1, 2): 0.06666666666666667}
Sender 4 got filter 1 choose option: (1, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 41.0}
in get_filtered_urn(filter=1) --- total: total=53.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.18867924528301888, (1, 1): 0.03773584905660377, (1, 2): 0.7735849056603774}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.18867924528301888, (1, 1): 0.03773584905660377, (1, 2): 0.7735849056603774}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 1): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 106.0}
in get_filtered_urn(filter=1) --- total: total=108.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.009259259259259259, (1, 1): 0.009259259259259259, (1, 2): 0.9814814814814815}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.009259259259259259, (1, 1): 0.009259259259259259, (1, 2): 0.9814814814814815}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 106.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=108.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.009259259259259259, (2, 1): 0.9814814814814815, (2, 2): 0.009259259259259259}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.009259259259259259, (2, 1): 0.9814814814814815, (2, 2): 0.009259259259259259}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 106.0 -> 107.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 106.0 -> 107.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 54.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=60.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9, (1, 1): 0.03333333333333333, (1, 2): 0.06666666666666667}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9, (1, 1): 0.03333333333333333, (1, 2): 0.06666666666666667}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 54.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=64.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03125, (0, 1): 0.84375, (0, 2): 0.125}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.03125, (0, 1): 0.84375, (0, 2): 0.125}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 54.0 -> 54.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 8.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 65.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=70.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9285714285714286, (2, 1): 0.05714285714285714, (2, 2): 0.014285714285714285}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9285714285714286, (2, 1): 0.05714285714285714, (2, 2): 0.014285714285714285}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 65.0}
in get_filtered_urn(filter=0) --- total: total=67.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014925373134328358, (0, 1): 0.014925373134328358, (0, 2): 0.9701492537313433}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.014925373134328358, (0, 1): 0.014925373134328358, (0, 2): 0.9701492537313433}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 65.0 -> 66.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 65.0 -> 66.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 41.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=51.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.1568627450980392, (2, 1): 0.803921568627451, (2, 2): 0.0392156862745098}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.1568627450980392, (2, 1): 0.803921568627451, (2, 2): 0.0392156862745098}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 41.0}
in get_filtered_urn(filter=1) --- total: total=53.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.18867924528301888, (1, 1): 0.03773584905660377, (1, 2): 0.7735849056603774}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.18867924528301888, (1, 1): 0.03773584905660377, (1, 2): 0.7735849056603774}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 41.0 -> 41.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 66.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=71.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9295774647887324, (2, 1): 0.056338028169014086, (2, 2): 0.014084507042253521}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9295774647887324, (2, 1): 0.056338028169014086, (2, 2): 0.014084507042253521}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 66.0}
in get_filtered_urn(filter=0) --- total: total=68.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014705882352941176, (0, 1): 0.014705882352941176, (0, 2): 0.9705882352941176}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.014705882352941176, (0, 1): 0.014705882352941176, (0, 2): 0.9705882352941176}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 66.0 -> 67.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 66.0 -> 67.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 51.0}
in get_filtered_urn(filter=0) --- total: total=63.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.031746031746031744, (0, 1): 0.15873015873015872, (0, 2): 0.8095238095238095}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.031746031746031744, (0, 1): 0.15873015873015872, (0, 2): 0.8095238095238095}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 51.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=57.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8947368421052632, (2, 1): 0.07017543859649122, (2, 2): 0.03508771929824561}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8947368421052632, (2, 1): 0.07017543859649122, (2, 2): 0.03508771929824561}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 51.0 -> 52.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 51.0 -> 52.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 107.0}
in get_filtered_urn(filter=1) --- total: total=109.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.009174311926605505, (1, 1): 0.009174311926605505, (1, 2): 0.981651376146789}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.009174311926605505, (1, 1): 0.009174311926605505, (1, 2): 0.981651376146789}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 107.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=109.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.009174311926605505, (2, 1): 0.981651376146789, (2, 2): 0.009174311926605505}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.009174311926605505, (2, 1): 0.981651376146789, (2, 2): 0.009174311926605505}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 107.0 -> 108.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 107.0 -> 108.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 54.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=60.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9, (1, 1): 0.03333333333333333, (1, 2): 0.06666666666666667}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9, (1, 1): 0.03333333333333333, (1, 2): 0.06666666666666667}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 54.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=64.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03125, (0, 1): 0.84375, (0, 2): 0.125}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.03125, (0, 1): 0.84375, (0, 2): 0.125}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 54.0 -> 55.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 54.0 -> 55.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 108.0}
in get_filtered_urn(filter=1) --- total: total=110.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.00909090909090909, (1, 1): 0.00909090909090909, (1, 2): 0.9818181818181818}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.00909090909090909, (1, 1): 0.00909090909090909, (1, 2): 0.9818181818181818}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 108.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=110.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.00909090909090909, (2, 1): 0.9818181818181818, (2, 2): 0.00909090909090909}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.00909090909090909, (2, 1): 0.9818181818181818, (2, 2): 0.00909090909090909}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 108.0 -> 109.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 108.0 -> 109.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 52.0}
in get_filtered_urn(filter=0) --- total: total=64.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03125, (0, 1): 0.15625, (0, 2): 0.8125}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.03125, (0, 1): 0.15625, (0, 2): 0.8125}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 52.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=58.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.896551724137931, (2, 1): 0.06896551724137931, (2, 2): 0.034482758620689655}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.896551724137931, (2, 1): 0.06896551724137931, (2, 2): 0.034482758620689655}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 52.0 -> 53.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 52.0 -> 53.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 67.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=72.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9305555555555556, (2, 1): 0.05555555555555555, (2, 2): 0.013888888888888888}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9305555555555556, (2, 1): 0.05555555555555555, (2, 2): 0.013888888888888888}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 67.0}
in get_filtered_urn(filter=0) --- total: total=69.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014492753623188406, (0, 1): 0.014492753623188406, (0, 2): 0.9710144927536232}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.014492753623188406, (0, 1): 0.014492753623188406, (0, 2): 0.9710144927536232}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 67.0 -> 68.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 67.0 -> 68.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 55.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=61.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9016393442622951, (1, 1): 0.03278688524590164, (1, 2): 0.06557377049180328}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9016393442622951, (1, 1): 0.03278688524590164, (1, 2): 0.06557377049180328}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 55.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=65.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03076923076923077, (0, 1): 0.8461538461538461, (0, 2): 0.12307692307692308}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.03076923076923077, (0, 1): 0.8461538461538461, (0, 2): 0.12307692307692308}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 55.0 -> 56.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 55.0 -> 56.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 109.0}
in get_filtered_urn(filter=1) --- total: total=111.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.009009009009009009, (1, 1): 0.009009009009009009, (1, 2): 0.9819819819819819}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.009009009009009009, (1, 1): 0.009009009009009009, (1, 2): 0.9819819819819819}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 109.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=111.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.009009009009009009, (2, 1): 0.9819819819819819, (2, 2): 0.009009009009009009}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.009009009009009009, (2, 1): 0.9819819819819819, (2, 2): 0.009009009009009009}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 109.0 -> 110.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 109.0 -> 110.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 41.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=51.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.1568627450980392, (2, 1): 0.803921568627451, (2, 2): 0.0392156862745098}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.1568627450980392, (2, 1): 0.803921568627451, (2, 2): 0.0392156862745098}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 41.0}
in get_filtered_urn(filter=1) --- total: total=53.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.18867924528301888, (1, 1): 0.03773584905660377, (1, 2): 0.7735849056603774}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.18867924528301888, (1, 1): 0.03773584905660377, (1, 2): 0.7735849056603774}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 41.0 -> 42.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 41.0 -> 42.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 110.0}
in get_filtered_urn(filter=1) --- total: total=112.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.008928571428571428, (1, 1): 0.008928571428571428, (1, 2): 0.9821428571428571}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.008928571428571428, (1, 1): 0.008928571428571428, (1, 2): 0.9821428571428571}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 110.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=112.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.008928571428571428, (2, 1): 0.9821428571428571, (2, 2): 0.008928571428571428}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.008928571428571428, (2, 1): 0.9821428571428571, (2, 2): 0.008928571428571428}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 110.0 -> 111.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 110.0 -> 111.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 42.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=52.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.15384615384615385, (2, 1): 0.8076923076923077, (2, 2): 0.038461538461538464}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.15384615384615385, (2, 1): 0.8076923076923077, (2, 2): 0.038461538461538464}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 53.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=59.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8983050847457628, (2, 1): 0.06779661016949153, (2, 2): 0.03389830508474576}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8983050847457628, (2, 1): 0.06779661016949153, (2, 2): 0.03389830508474576}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 53.0 -> 53.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 77.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=79.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012658227848101266, (0, 1): 0.9746835443037974, (0, 2): 0.012658227848101266}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.012658227848101266, (0, 1): 0.9746835443037974, (0, 2): 0.012658227848101266}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 77.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=82.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9390243902439024, (1, 1): 0.012195121951219513, (1, 2): 0.04878048780487805}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9390243902439024, (1, 1): 0.012195121951219513, (1, 2): 0.04878048780487805}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 77.0 -> 78.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 77.0 -> 78.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 42.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=52.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.15384615384615385, (2, 1): 0.8076923076923077, (2, 2): 0.038461538461538464}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.15384615384615385, (2, 1): 0.8076923076923077, (2, 2): 0.038461538461538464}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 42.0}
in get_filtered_urn(filter=1) --- total: total=54.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.18518518518518517, (1, 1): 0.037037037037037035, (1, 2): 0.7777777777777778}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.18518518518518517, (1, 1): 0.037037037037037035, (1, 2): 0.7777777777777778}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 42.0 -> 42.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 68.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=73.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9315068493150684, (2, 1): 0.0547945205479452, (2, 2): 0.0136986301369863}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9315068493150684, (2, 1): 0.0547945205479452, (2, 2): 0.0136986301369863}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 68.0}
in get_filtered_urn(filter=0) --- total: total=70.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014285714285714285, (0, 1): 0.014285714285714285, (0, 2): 0.9714285714285714}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.014285714285714285, (0, 1): 0.014285714285714285, (0, 2): 0.9714285714285714}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 68.0 -> 69.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 68.0 -> 69.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 42.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=52.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.15384615384615385, (2, 1): 0.8076923076923077, (2, 2): 0.038461538461538464}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.15384615384615385, (2, 1): 0.8076923076923077, (2, 2): 0.038461538461538464}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 56.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=66.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.030303030303030304, (0, 1): 0.8484848484848485, (0, 2): 0.12121212121212122}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.030303030303030304, (0, 1): 0.8484848484848485, (0, 2): 0.12121212121212122}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 8.0 -> 8.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 56.0 -> 56.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 111.0}
in get_filtered_urn(filter=1) --- total: total=113.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.008849557522123894, (1, 1): 0.008849557522123894, (1, 2): 0.9823008849557522}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.008849557522123894, (1, 1): 0.008849557522123894, (1, 2): 0.9823008849557522}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 111.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=113.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.008849557522123894, (2, 1): 0.9823008849557522, (2, 2): 0.008849557522123894}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.008849557522123894, (2, 1): 0.9823008849557522, (2, 2): 0.008849557522123894}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 111.0 -> 112.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 111.0 -> 112.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 42.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=52.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.15384615384615385, (2, 1): 0.8076923076923077, (2, 2): 0.038461538461538464}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.15384615384615385, (2, 1): 0.8076923076923077, (2, 2): 0.038461538461538464}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 42.0}
in get_filtered_urn(filter=1) --- total: total=54.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.18518518518518517, (1, 1): 0.037037037037037035, (1, 2): 0.7777777777777778}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.18518518518518517, (1, 1): 0.037037037037037035, (1, 2): 0.7777777777777778}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 42.0 -> 43.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 42.0 -> 43.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 112.0}
in get_filtered_urn(filter=1) --- total: total=114.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.008771929824561403, (1, 1): 0.008771929824561403, (1, 2): 0.9824561403508771}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.008771929824561403, (1, 1): 0.008771929824561403, (1, 2): 0.9824561403508771}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 112.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=114.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.008771929824561403, (2, 1): 0.9824561403508771, (2, 2): 0.008771929824561403}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.008771929824561403, (2, 1): 0.9824561403508771, (2, 2): 0.008771929824561403}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 112.0 -> 113.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 112.0 -> 113.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 56.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=62.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9032258064516129, (1, 1): 0.03225806451612903, (1, 2): 0.06451612903225806}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9032258064516129, (1, 1): 0.03225806451612903, (1, 2): 0.06451612903225806}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 56.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=66.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.030303030303030304, (0, 1): 0.8484848484848485, (0, 2): 0.12121212121212122}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.030303030303030304, (0, 1): 0.8484848484848485, (0, 2): 0.12121212121212122}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 56.0 -> 57.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 56.0 -> 57.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 113.0}
in get_filtered_urn(filter=1) --- total: total=115.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.008695652173913044, (1, 1): 0.008695652173913044, (1, 2): 0.9826086956521739}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.008695652173913044, (1, 1): 0.008695652173913044, (1, 2): 0.9826086956521739}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 113.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=115.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.008695652173913044, (2, 1): 0.9826086956521739, (2, 2): 0.008695652173913044}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.008695652173913044, (2, 1): 0.9826086956521739, (2, 2): 0.008695652173913044}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 113.0 -> 114.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 113.0 -> 114.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 43.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=53.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.1509433962264151, (2, 1): 0.8113207547169812, (2, 2): 0.03773584905660377}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.1509433962264151, (2, 1): 0.8113207547169812, (2, 2): 0.03773584905660377}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 43.0}
in get_filtered_urn(filter=1) --- total: total=55.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.18181818181818182, (1, 1): 0.03636363636363636, (1, 2): 0.7818181818181819}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.18181818181818182, (1, 1): 0.03636363636363636, (1, 2): 0.7818181818181819}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 43.0 -> 44.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 43.0 -> 44.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 114.0}
in get_filtered_urn(filter=1) --- total: total=116.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.008620689655172414, (1, 1): 0.008620689655172414, (1, 2): 0.9827586206896551}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.008620689655172414, (1, 1): 0.008620689655172414, (1, 2): 0.9827586206896551}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 114.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=116.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.008620689655172414, (2, 1): 0.9827586206896551, (2, 2): 0.008620689655172414}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.008620689655172414, (2, 1): 0.9827586206896551, (2, 2): 0.008620689655172414}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 114.0 -> 115.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 114.0 -> 115.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 53.0}
in get_filtered_urn(filter=0) --- total: total=65.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.03076923076923077, (0, 1): 0.15384615384615385, (0, 2): 0.8153846153846154}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.03076923076923077, (0, 1): 0.15384615384615385, (0, 2): 0.8153846153846154}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 53.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=59.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.8983050847457628, (2, 1): 0.06779661016949153, (2, 2): 0.03389830508474576}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.8983050847457628, (2, 1): 0.06779661016949153, (2, 2): 0.03389830508474576}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 53.0 -> 54.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 53.0 -> 54.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 78.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=80.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0125, (0, 1): 0.975, (0, 2): 0.0125}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0125, (0, 1): 0.975, (0, 2): 0.0125}
Sender 1 got filter 0 choose option: (0, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 115.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=117.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.008547008547008548, (2, 1): 0.9829059829059829, (2, 2): 0.008547008547008548}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.008547008547008548, (2, 1): 0.9829059829059829, (2, 2): 0.008547008547008548}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 2): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 1): 115.0 -> 115.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 44.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=54.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.14814814814814814, (2, 1): 0.8148148148148148, (2, 2): 0.037037037037037035}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.14814814814814814, (2, 1): 0.8148148148148148, (2, 2): 0.037037037037037035}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 44.0}
in get_filtered_urn(filter=1) --- total: total=56.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.17857142857142858, (1, 1): 0.03571428571428571, (1, 2): 0.7857142857142857}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.17857142857142858, (1, 1): 0.03571428571428571, (1, 2): 0.7857142857142857}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 44.0 -> 45.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 44.0 -> 45.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 78.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=80.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0125, (0, 1): 0.975, (0, 2): 0.0125}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0125, (0, 1): 0.975, (0, 2): 0.0125}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 78.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=83.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9397590361445783, (1, 1): 0.012048192771084338, (1, 2): 0.04819277108433735}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9397590361445783, (1, 1): 0.012048192771084338, (1, 2): 0.04819277108433735}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 78.0 -> 79.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 78.0 -> 79.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 45.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=55.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.14545454545454545, (2, 1): 0.8181818181818182, (2, 2): 0.03636363636363636}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.14545454545454545, (2, 1): 0.8181818181818182, (2, 2): 0.03636363636363636}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 45.0}
in get_filtered_urn(filter=1) --- total: total=57.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.17543859649122806, (1, 1): 0.03508771929824561, (1, 2): 0.7894736842105263}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.17543859649122806, (1, 1): 0.03508771929824561, (1, 2): 0.7894736842105263}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 45.0 -> 45.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 115.0}
in get_filtered_urn(filter=1) --- total: total=117.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.008547008547008548, (1, 1): 0.008547008547008548, (1, 2): 0.9829059829059829}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.008547008547008548, (1, 1): 0.008547008547008548, (1, 2): 0.9829059829059829}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 115.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=117.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.008547008547008548, (2, 1): 0.9829059829059829, (2, 2): 0.008547008547008548}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.008547008547008548, (2, 1): 0.9829059829059829, (2, 2): 0.008547008547008548}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 115.0 -> 116.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 115.0 -> 116.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 54.0}
in get_filtered_urn(filter=0) --- total: total=66.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.030303030303030304, (0, 1): 0.15151515151515152, (0, 2): 0.8181818181818182}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.030303030303030304, (0, 1): 0.15151515151515152, (0, 2): 0.8181818181818182}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 54.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=60.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9, (2, 1): 0.06666666666666667, (2, 2): 0.03333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9, (2, 1): 0.06666666666666667, (2, 2): 0.03333333333333333}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 54.0 -> 55.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 54.0 -> 55.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 69.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=74.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9324324324324325, (2, 1): 0.05405405405405406, (2, 2): 0.013513513513513514}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9324324324324325, (2, 1): 0.05405405405405406, (2, 2): 0.013513513513513514}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 69.0}
in get_filtered_urn(filter=0) --- total: total=71.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014084507042253521, (0, 1): 0.014084507042253521, (0, 2): 0.971830985915493}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.014084507042253521, (0, 1): 0.014084507042253521, (0, 2): 0.971830985915493}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 69.0 -> 70.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 69.0 -> 70.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 55.0}
in get_filtered_urn(filter=0) --- total: total=67.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.029850746268656716, (0, 1): 0.14925373134328357, (0, 2): 0.8208955223880597}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.029850746268656716, (0, 1): 0.14925373134328357, (0, 2): 0.8208955223880597}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 55.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=61.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9016393442622951, (2, 1): 0.06557377049180328, (2, 2): 0.03278688524590164}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9016393442622951, (2, 1): 0.06557377049180328, (2, 2): 0.03278688524590164}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 55.0 -> 56.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 55.0 -> 56.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 70.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=75.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9333333333333333, (2, 1): 0.05333333333333334, (2, 2): 0.013333333333333334}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9333333333333333, (2, 1): 0.05333333333333334, (2, 2): 0.013333333333333334}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 70.0}
in get_filtered_urn(filter=0) --- total: total=72.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013888888888888888, (0, 1): 0.013888888888888888, (0, 2): 0.9722222222222222}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.013888888888888888, (0, 1): 0.013888888888888888, (0, 2): 0.9722222222222222}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 70.0 -> 71.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 70.0 -> 71.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 45.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=55.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.14545454545454545, (2, 1): 0.8181818181818182, (2, 2): 0.03636363636363636}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.14545454545454545, (2, 1): 0.8181818181818182, (2, 2): 0.03636363636363636}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 45.0}
in get_filtered_urn(filter=1) --- total: total=57.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.17543859649122806, (1, 1): 0.03508771929824561, (1, 2): 0.7894736842105263}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.17543859649122806, (1, 1): 0.03508771929824561, (1, 2): 0.7894736842105263}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 45.0 -> 46.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 45.0 -> 46.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 116.0}
in get_filtered_urn(filter=1) --- total: total=118.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.00847457627118644, (1, 1): 0.00847457627118644, (1, 2): 0.9830508474576272}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.00847457627118644, (1, 1): 0.00847457627118644, (1, 2): 0.9830508474576272}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 116.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=118.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.00847457627118644, (2, 1): 0.9830508474576272, (2, 2): 0.00847457627118644}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.00847457627118644, (2, 1): 0.9830508474576272, (2, 2): 0.00847457627118644}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 116.0 -> 117.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 116.0 -> 117.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 46.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=56.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.14285714285714285, (2, 1): 0.8214285714285714, (2, 2): 0.03571428571428571}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.14285714285714285, (2, 1): 0.8214285714285714, (2, 2): 0.03571428571428571}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 46.0}
in get_filtered_urn(filter=1) --- total: total=58.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.1724137931034483, (1, 1): 0.034482758620689655, (1, 2): 0.7931034482758621}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.1724137931034483, (1, 1): 0.034482758620689655, (1, 2): 0.7931034482758621}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 46.0 -> 47.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 46.0 -> 47.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 71.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=76.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9342105263157895, (2, 1): 0.05263157894736842, (2, 2): 0.013157894736842105}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9342105263157895, (2, 1): 0.05263157894736842, (2, 2): 0.013157894736842105}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 71.0}
in get_filtered_urn(filter=0) --- total: total=73.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0136986301369863, (0, 1): 0.0136986301369863, (0, 2): 0.9726027397260274}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0136986301369863, (0, 1): 0.0136986301369863, (0, 2): 0.9726027397260274}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 71.0 -> 72.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 71.0 -> 72.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 57.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=63.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9047619047619048, (1, 1): 0.031746031746031744, (1, 2): 0.06349206349206349}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9047619047619048, (1, 1): 0.031746031746031744, (1, 2): 0.06349206349206349}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 57.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=67.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.029850746268656716, (0, 1): 0.8507462686567164, (0, 2): 0.11940298507462686}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.029850746268656716, (0, 1): 0.8507462686567164, (0, 2): 0.11940298507462686}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 57.0 -> 58.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 57.0 -> 58.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 79.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=81.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012345679012345678, (0, 1): 0.9753086419753086, (0, 2): 0.012345679012345678}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.012345679012345678, (0, 1): 0.9753086419753086, (0, 2): 0.012345679012345678}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 79.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=84.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9404761904761905, (1, 1): 0.011904761904761904, (1, 2): 0.047619047619047616}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9404761904761905, (1, 1): 0.011904761904761904, (1, 2): 0.047619047619047616}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 79.0 -> 80.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 79.0 -> 80.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 47.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=57.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.14035087719298245, (2, 1): 0.8245614035087719, (2, 2): 0.03508771929824561}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.14035087719298245, (2, 1): 0.8245614035087719, (2, 2): 0.03508771929824561}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 47.0}
in get_filtered_urn(filter=1) --- total: total=59.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.1694915254237288, (1, 1): 0.03389830508474576, (1, 2): 0.7966101694915254}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.1694915254237288, (1, 1): 0.03389830508474576, (1, 2): 0.7966101694915254}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 47.0 -> 48.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 47.0 -> 48.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 80.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=82.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012195121951219513, (0, 1): 0.975609756097561, (0, 2): 0.012195121951219513}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.012195121951219513, (0, 1): 0.975609756097561, (0, 2): 0.012195121951219513}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 80.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=85.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9411764705882353, (1, 1): 0.011764705882352941, (1, 2): 0.047058823529411764}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9411764705882353, (1, 1): 0.011764705882352941, (1, 2): 0.047058823529411764}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 80.0 -> 81.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 80.0 -> 81.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 58.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=64.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.90625, (1, 1): 0.03125, (1, 2): 0.0625}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.90625, (1, 1): 0.03125, (1, 2): 0.0625}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 58.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=68.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.029411764705882353, (0, 1): 0.8529411764705882, (0, 2): 0.11764705882352941}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.029411764705882353, (0, 1): 0.8529411764705882, (0, 2): 0.11764705882352941}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 58.0 -> 59.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 58.0 -> 59.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 117.0}
in get_filtered_urn(filter=1) --- total: total=119.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.008403361344537815, (1, 1): 0.008403361344537815, (1, 2): 0.9831932773109243}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.008403361344537815, (1, 1): 0.008403361344537815, (1, 2): 0.9831932773109243}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 117.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=119.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.008403361344537815, (2, 1): 0.9831932773109243, (2, 2): 0.008403361344537815}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.008403361344537815, (2, 1): 0.9831932773109243, (2, 2): 0.008403361344537815}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 117.0 -> 118.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 117.0 -> 118.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 48.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=58.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.13793103448275862, (2, 1): 0.8275862068965517, (2, 2): 0.034482758620689655}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.13793103448275862, (2, 1): 0.8275862068965517, (2, 2): 0.034482758620689655}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 48.0}
in get_filtered_urn(filter=1) --- total: total=60.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.16666666666666666, (1, 1): 0.03333333333333333, (1, 2): 0.8}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.16666666666666666, (1, 1): 0.03333333333333333, (1, 2): 0.8}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 48.0 -> 49.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 48.0 -> 49.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 81.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=83.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012048192771084338, (0, 1): 0.9759036144578314, (0, 2): 0.012048192771084338}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.012048192771084338, (0, 1): 0.9759036144578314, (0, 2): 0.012048192771084338}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 81.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=86.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9418604651162791, (1, 1): 0.011627906976744186, (1, 2): 0.046511627906976744}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9418604651162791, (1, 1): 0.011627906976744186, (1, 2): 0.046511627906976744}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 81.0 -> 82.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 81.0 -> 82.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 56.0}
in get_filtered_urn(filter=0) --- total: total=68.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.029411764705882353, (0, 1): 0.14705882352941177, (0, 2): 0.8235294117647058}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.029411764705882353, (0, 1): 0.14705882352941177, (0, 2): 0.8235294117647058}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 56.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=62.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9032258064516129, (2, 1): 0.06451612903225806, (2, 2): 0.03225806451612903}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9032258064516129, (2, 1): 0.06451612903225806, (2, 2): 0.03225806451612903}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 56.0 -> 57.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 56.0 -> 57.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 118.0}
in get_filtered_urn(filter=1) --- total: total=120.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.008333333333333333, (1, 1): 0.008333333333333333, (1, 2): 0.9833333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.008333333333333333, (1, 1): 0.008333333333333333, (1, 2): 0.9833333333333333}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 118.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=120.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.008333333333333333, (2, 1): 0.9833333333333333, (2, 2): 0.008333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.008333333333333333, (2, 1): 0.9833333333333333, (2, 2): 0.008333333333333333}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 118.0 -> 119.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 118.0 -> 119.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 49.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=59.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.13559322033898305, (2, 1): 0.8305084745762712, (2, 2): 0.03389830508474576}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.13559322033898305, (2, 1): 0.8305084745762712, (2, 2): 0.03389830508474576}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 49.0}
in get_filtered_urn(filter=1) --- total: total=61.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.16393442622950818, (1, 1): 0.03278688524590164, (1, 2): 0.8032786885245902}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.16393442622950818, (1, 1): 0.03278688524590164, (1, 2): 0.8032786885245902}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 49.0 -> 49.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 119.0}
in get_filtered_urn(filter=1) --- total: total=121.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.008264462809917356, (1, 1): 0.008264462809917356, (1, 2): 0.9834710743801653}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.008264462809917356, (1, 1): 0.008264462809917356, (1, 2): 0.9834710743801653}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 119.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=121.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.008264462809917356, (2, 1): 0.9834710743801653, (2, 2): 0.008264462809917356}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.008264462809917356, (2, 1): 0.9834710743801653, (2, 2): 0.008264462809917356}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 119.0 -> 120.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 119.0 -> 120.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 57.0}
in get_filtered_urn(filter=0) --- total: total=69.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.028985507246376812, (0, 1): 0.14492753623188406, (0, 2): 0.8260869565217391}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.028985507246376812, (0, 1): 0.14492753623188406, (0, 2): 0.8260869565217391}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 57.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=63.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9047619047619048, (2, 1): 0.06349206349206349, (2, 2): 0.031746031746031744}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9047619047619048, (2, 1): 0.06349206349206349, (2, 2): 0.031746031746031744}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 57.0 -> 58.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 57.0 -> 58.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 82.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=84.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011904761904761904, (0, 1): 0.9761904761904762, (0, 2): 0.011904761904761904}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011904761904761904, (0, 1): 0.9761904761904762, (0, 2): 0.011904761904761904}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 82.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=87.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9425287356321839, (1, 1): 0.011494252873563218, (1, 2): 0.04597701149425287}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9425287356321839, (1, 1): 0.011494252873563218, (1, 2): 0.04597701149425287}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 82.0 -> 83.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 82.0 -> 83.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 59.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=65.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9076923076923077, (1, 1): 0.03076923076923077, (1, 2): 0.06153846153846154}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.9076923076923077, (1, 1): 0.03076923076923077, (1, 2): 0.06153846153846154}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 58.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=64.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.90625, (2, 1): 0.0625, (2, 2): 0.03125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.90625, (2, 1): 0.0625, (2, 2): 0.03125}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 58.0 -> 58.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 83.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=85.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011764705882352941, (0, 1): 0.9764705882352941, (0, 2): 0.011764705882352941}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011764705882352941, (0, 1): 0.9764705882352941, (0, 2): 0.011764705882352941}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 83.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=88.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9431818181818182, (1, 1): 0.011363636363636364, (1, 2): 0.045454545454545456}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9431818181818182, (1, 1): 0.011363636363636364, (1, 2): 0.045454545454545456}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 83.0 -> 84.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 83.0 -> 84.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 59.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=65.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9076923076923077, (1, 1): 0.03076923076923077, (1, 2): 0.06153846153846154}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9076923076923077, (1, 1): 0.03076923076923077, (1, 2): 0.06153846153846154}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 59.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=69.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.028985507246376812, (0, 1): 0.855072463768116, (0, 2): 0.11594202898550725}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.028985507246376812, (0, 1): 0.855072463768116, (0, 2): 0.11594202898550725}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 59.0 -> 60.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 59.0 -> 60.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 72.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=77.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.935064935064935, (2, 1): 0.05194805194805195, (2, 2): 0.012987012987012988}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.935064935064935, (2, 1): 0.05194805194805195, (2, 2): 0.012987012987012988}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 72.0}
in get_filtered_urn(filter=0) --- total: total=74.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013513513513513514, (0, 1): 0.013513513513513514, (0, 2): 0.972972972972973}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.013513513513513514, (0, 1): 0.013513513513513514, (0, 2): 0.972972972972973}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 72.0 -> 73.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 72.0 -> 73.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 60.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=66.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9090909090909091, (1, 1): 0.030303030303030304, (1, 2): 0.06060606060606061}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9090909090909091, (1, 1): 0.030303030303030304, (1, 2): 0.06060606060606061}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 60.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=70.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02857142857142857, (0, 1): 0.8571428571428571, (0, 2): 0.11428571428571428}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.02857142857142857, (0, 1): 0.8571428571428571, (0, 2): 0.11428571428571428}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 60.0 -> 61.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 60.0 -> 61.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 84.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=86.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011627906976744186, (0, 1): 0.9767441860465116, (0, 2): 0.011627906976744186}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011627906976744186, (0, 1): 0.9767441860465116, (0, 2): 0.011627906976744186}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 84.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=89.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9438202247191011, (1, 1): 0.011235955056179775, (1, 2): 0.0449438202247191}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9438202247191011, (1, 1): 0.011235955056179775, (1, 2): 0.0449438202247191}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 84.0 -> 85.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 84.0 -> 85.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 61.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=67.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9104477611940298, (1, 1): 0.029850746268656716, (1, 2): 0.05970149253731343}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9104477611940298, (1, 1): 0.029850746268656716, (1, 2): 0.05970149253731343}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 61.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=71.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.028169014084507043, (0, 1): 0.8591549295774648, (0, 2): 0.11267605633802817}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.028169014084507043, (0, 1): 0.8591549295774648, (0, 2): 0.11267605633802817}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 61.0 -> 62.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 61.0 -> 62.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 120.0}
in get_filtered_urn(filter=1) --- total: total=122.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.00819672131147541, (1, 1): 0.00819672131147541, (1, 2): 0.9836065573770492}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.00819672131147541, (1, 1): 0.00819672131147541, (1, 2): 0.9836065573770492}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 120.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=122.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.00819672131147541, (2, 1): 0.9836065573770492, (2, 2): 0.00819672131147541}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.00819672131147541, (2, 1): 0.9836065573770492, (2, 2): 0.00819672131147541}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 120.0 -> 121.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 120.0 -> 121.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 58.0}
in get_filtered_urn(filter=0) --- total: total=70.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02857142857142857, (0, 1): 0.14285714285714285, (0, 2): 0.8285714285714286}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02857142857142857, (0, 1): 0.14285714285714285, (0, 2): 0.8285714285714286}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 58.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=64.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.90625, (2, 1): 0.0625, (2, 2): 0.03125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.90625, (2, 1): 0.0625, (2, 2): 0.03125}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 58.0 -> 59.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 58.0 -> 59.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 73.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=78.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9358974358974359, (2, 1): 0.05128205128205128, (2, 2): 0.01282051282051282}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9358974358974359, (2, 1): 0.05128205128205128, (2, 2): 0.01282051282051282}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 73.0}
in get_filtered_urn(filter=0) --- total: total=75.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013333333333333334, (0, 1): 0.013333333333333334, (0, 2): 0.9733333333333334}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.013333333333333334, (0, 1): 0.013333333333333334, (0, 2): 0.9733333333333334}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 73.0 -> 74.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 73.0 -> 74.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 49.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=59.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.13559322033898305, (2, 1): 0.8305084745762712, (2, 2): 0.03389830508474576}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.13559322033898305, (2, 1): 0.8305084745762712, (2, 2): 0.03389830508474576}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 49.0}
in get_filtered_urn(filter=1) --- total: total=61.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.16393442622950818, (1, 1): 0.03278688524590164, (1, 2): 0.8032786885245902}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.16393442622950818, (1, 1): 0.03278688524590164, (1, 2): 0.8032786885245902}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 49.0 -> 50.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 49.0 -> 50.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 85.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=87.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011494252873563218, (0, 1): 0.9770114942528736, (0, 2): 0.011494252873563218}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011494252873563218, (0, 1): 0.9770114942528736, (0, 2): 0.011494252873563218}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 85.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=90.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9444444444444444, (1, 1): 0.011111111111111112, (1, 2): 0.044444444444444446}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9444444444444444, (1, 1): 0.011111111111111112, (1, 2): 0.044444444444444446}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 85.0 -> 86.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 85.0 -> 86.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 59.0}
in get_filtered_urn(filter=0) --- total: total=71.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.028169014084507043, (0, 1): 0.14084507042253522, (0, 2): 0.8309859154929577}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.028169014084507043, (0, 1): 0.14084507042253522, (0, 2): 0.8309859154929577}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 59.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=65.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9076923076923077, (2, 1): 0.06153846153846154, (2, 2): 0.03076923076923077}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9076923076923077, (2, 1): 0.06153846153846154, (2, 2): 0.03076923076923077}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 59.0 -> 60.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 59.0 -> 60.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 121.0}
in get_filtered_urn(filter=1) --- total: total=123.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.008130081300813009, (1, 1): 0.008130081300813009, (1, 2): 0.983739837398374}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.008130081300813009, (1, 1): 0.008130081300813009, (1, 2): 0.983739837398374}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 121.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=123.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.008130081300813009, (2, 1): 0.983739837398374, (2, 2): 0.008130081300813009}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.008130081300813009, (2, 1): 0.983739837398374, (2, 2): 0.008130081300813009}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 121.0 -> 122.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 121.0 -> 122.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 60.0}
in get_filtered_urn(filter=0) --- total: total=72.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.027777777777777776, (0, 1): 0.1388888888888889, (0, 2): 0.8333333333333334}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.027777777777777776, (0, 1): 0.1388888888888889, (0, 2): 0.8333333333333334}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 60.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=66.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9090909090909091, (2, 1): 0.06060606060606061, (2, 2): 0.030303030303030304}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.9090909090909091, (2, 1): 0.06060606060606061, (2, 2): 0.030303030303030304}
in decode_message(signal=2) Receiver 5 got option: (2, 1) and decoded action: 1
Receiver 5 received signals: [2] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 2): 60.0 -> 60.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 1): 4.0 -> 4.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 122.0}
in get_filtered_urn(filter=1) --- total: total=124.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.008064516129032258, (1, 1): 0.008064516129032258, (1, 2): 0.9838709677419355}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.008064516129032258, (1, 1): 0.008064516129032258, (1, 2): 0.9838709677419355}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 122.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=124.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.008064516129032258, (2, 1): 0.9838709677419355, (2, 2): 0.008064516129032258}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.008064516129032258, (2, 1): 0.9838709677419355, (2, 2): 0.008064516129032258}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 122.0 -> 123.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 122.0 -> 123.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 50.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=60.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.13333333333333333, (2, 1): 0.8333333333333334, (2, 2): 0.03333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.13333333333333333, (2, 1): 0.8333333333333334, (2, 2): 0.03333333333333333}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 50.0}
in get_filtered_urn(filter=1) --- total: total=62.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.16129032258064516, (1, 1): 0.03225806451612903, (1, 2): 0.8064516129032258}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.16129032258064516, (1, 1): 0.03225806451612903, (1, 2): 0.8064516129032258}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 50.0 -> 51.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 50.0 -> 51.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 123.0}
in get_filtered_urn(filter=1) --- total: total=125.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.008, (1, 1): 0.008, (1, 2): 0.984}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.008, (1, 1): 0.008, (1, 2): 0.984}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 123.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=125.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.008, (2, 1): 0.984, (2, 2): 0.008}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.008, (2, 1): 0.984, (2, 2): 0.008}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 123.0 -> 124.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 123.0 -> 124.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 62.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=68.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9117647058823529, (1, 1): 0.029411764705882353, (1, 2): 0.058823529411764705}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9117647058823529, (1, 1): 0.029411764705882353, (1, 2): 0.058823529411764705}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 62.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=72.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.027777777777777776, (0, 1): 0.8611111111111112, (0, 2): 0.1111111111111111}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.027777777777777776, (0, 1): 0.8611111111111112, (0, 2): 0.1111111111111111}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 62.0 -> 63.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 62.0 -> 63.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 124.0}
in get_filtered_urn(filter=1) --- total: total=126.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.007936507936507936, (1, 1): 0.007936507936507936, (1, 2): 0.9841269841269841}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.007936507936507936, (1, 1): 0.007936507936507936, (1, 2): 0.9841269841269841}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 124.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=126.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.007936507936507936, (2, 1): 0.9841269841269841, (2, 2): 0.007936507936507936}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.007936507936507936, (2, 1): 0.9841269841269841, (2, 2): 0.007936507936507936}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 124.0 -> 125.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 124.0 -> 125.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 51.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=61.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.13114754098360656, (2, 1): 0.8360655737704918, (2, 2): 0.03278688524590164}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.13114754098360656, (2, 1): 0.8360655737704918, (2, 2): 0.03278688524590164}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 51.0}
in get_filtered_urn(filter=1) --- total: total=63.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.15873015873015872, (1, 1): 0.031746031746031744, (1, 2): 0.8095238095238095}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.15873015873015872, (1, 1): 0.031746031746031744, (1, 2): 0.8095238095238095}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 51.0 -> 52.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 51.0 -> 52.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 125.0}
in get_filtered_urn(filter=1) --- total: total=127.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.007874015748031496, (1, 1): 0.007874015748031496, (1, 2): 0.984251968503937}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.007874015748031496, (1, 1): 0.007874015748031496, (1, 2): 0.984251968503937}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 125.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=127.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.007874015748031496, (2, 1): 0.984251968503937, (2, 2): 0.007874015748031496}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.007874015748031496, (2, 1): 0.984251968503937, (2, 2): 0.007874015748031496}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 125.0 -> 126.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 125.0 -> 126.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 60.0}
in get_filtered_urn(filter=0) --- total: total=72.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.027777777777777776, (0, 1): 0.1388888888888889, (0, 2): 0.8333333333333334}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.027777777777777776, (0, 1): 0.1388888888888889, (0, 2): 0.8333333333333334}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 60.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=66.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9090909090909091, (2, 1): 0.06060606060606061, (2, 2): 0.030303030303030304}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9090909090909091, (2, 1): 0.06060606060606061, (2, 2): 0.030303030303030304}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 60.0 -> 61.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 60.0 -> 61.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 126.0}
in get_filtered_urn(filter=1) --- total: total=128.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0078125, (1, 1): 0.0078125, (1, 2): 0.984375}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0078125, (1, 1): 0.0078125, (1, 2): 0.984375}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 126.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=128.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0078125, (2, 1): 0.984375, (2, 2): 0.0078125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0078125, (2, 1): 0.984375, (2, 2): 0.0078125}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 126.0 -> 127.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 126.0 -> 127.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 63.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=69.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9130434782608695, (1, 1): 0.028985507246376812, (1, 2): 0.057971014492753624}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9130434782608695, (1, 1): 0.028985507246376812, (1, 2): 0.057971014492753624}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 63.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=73.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0273972602739726, (0, 1): 0.863013698630137, (0, 2): 0.1095890410958904}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0273972602739726, (0, 1): 0.863013698630137, (0, 2): 0.1095890410958904}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 63.0 -> 64.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 63.0 -> 64.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 86.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=88.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011363636363636364, (0, 1): 0.9772727272727273, (0, 2): 0.011363636363636364}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011363636363636364, (0, 1): 0.9772727272727273, (0, 2): 0.011363636363636364}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 86.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=91.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.945054945054945, (1, 1): 0.01098901098901099, (1, 2): 0.04395604395604396}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.945054945054945, (1, 1): 0.01098901098901099, (1, 2): 0.04395604395604396}
in decode_message(signal=1) Receiver 2 got option: (1, 2) and decoded action: 2
Receiver 2 received signals: [1] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 1): 86.0 -> 86.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 52.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=62.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.12903225806451613, (2, 1): 0.8387096774193549, (2, 2): 0.03225806451612903}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.12903225806451613, (2, 1): 0.8387096774193549, (2, 2): 0.03225806451612903}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 52.0}
in get_filtered_urn(filter=1) --- total: total=64.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.15625, (1, 1): 0.03125, (1, 2): 0.8125}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.15625, (1, 1): 0.03125, (1, 2): 0.8125}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 52.0 -> 53.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 52.0 -> 53.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 127.0}
in get_filtered_urn(filter=1) --- total: total=129.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.007751937984496124, (1, 1): 0.007751937984496124, (1, 2): 0.9844961240310077}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.007751937984496124, (1, 1): 0.007751937984496124, (1, 2): 0.9844961240310077}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 127.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=129.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.007751937984496124, (2, 1): 0.9844961240310077, (2, 2): 0.007751937984496124}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.007751937984496124, (2, 1): 0.9844961240310077, (2, 2): 0.007751937984496124}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 127.0 -> 128.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 127.0 -> 128.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 53.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=63.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.12698412698412698, (2, 1): 0.8412698412698413, (2, 2): 0.031746031746031744}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.12698412698412698, (2, 1): 0.8412698412698413, (2, 2): 0.031746031746031744}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 53.0}
in get_filtered_urn(filter=1) --- total: total=65.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.15384615384615385, (1, 1): 0.03076923076923077, (1, 2): 0.8153846153846154}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.15384615384615385, (1, 1): 0.03076923076923077, (1, 2): 0.8153846153846154}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 53.0 -> 54.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 53.0 -> 54.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 74.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=79.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9367088607594937, (2, 1): 0.05063291139240506, (2, 2): 0.012658227848101266}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.9367088607594937, (2, 1): 0.05063291139240506, (2, 2): 0.012658227848101266}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 86.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=91.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.945054945054945, (1, 1): 0.01098901098901099, (1, 2): 0.04395604395604396}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.945054945054945, (1, 1): 0.01098901098901099, (1, 2): 0.04395604395604396}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 1): 4.0 -> 4.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 0): 86.0 -> 86.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 64.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=70.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9142857142857143, (1, 1): 0.02857142857142857, (1, 2): 0.05714285714285714}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9142857142857143, (1, 1): 0.02857142857142857, (1, 2): 0.05714285714285714}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 64.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=74.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02702702702702703, (0, 1): 0.8648648648648649, (0, 2): 0.10810810810810811}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02702702702702703, (0, 1): 0.8648648648648649, (0, 2): 0.10810810810810811}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 64.0 -> 64.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 8.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 74.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=79.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9367088607594937, (2, 1): 0.05063291139240506, (2, 2): 0.012658227848101266}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9367088607594937, (2, 1): 0.05063291139240506, (2, 2): 0.012658227848101266}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 74.0}
in get_filtered_urn(filter=0) --- total: total=76.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013157894736842105, (0, 1): 0.013157894736842105, (0, 2): 0.9736842105263158}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.013157894736842105, (0, 1): 0.013157894736842105, (0, 2): 0.9736842105263158}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 74.0 -> 75.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 74.0 -> 75.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 61.0}
in get_filtered_urn(filter=0) --- total: total=73.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0273972602739726, (0, 1): 0.136986301369863, (0, 2): 0.8356164383561644}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0273972602739726, (0, 1): 0.136986301369863, (0, 2): 0.8356164383561644}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 54.0}
in get_filtered_urn(filter=1) --- total: total=66.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.15151515151515152, (1, 1): 0.030303030303030304, (1, 2): 0.8181818181818182}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.15151515151515152, (1, 1): 0.030303030303030304, (1, 2): 0.8181818181818182}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 54.0 -> 54.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 128.0}
in get_filtered_urn(filter=1) --- total: total=130.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.007692307692307693, (1, 1): 0.007692307692307693, (1, 2): 0.9846153846153847}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.007692307692307693, (1, 1): 0.007692307692307693, (1, 2): 0.9846153846153847}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 128.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=130.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.007692307692307693, (2, 1): 0.9846153846153847, (2, 2): 0.007692307692307693}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.007692307692307693, (2, 1): 0.9846153846153847, (2, 2): 0.007692307692307693}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 128.0 -> 129.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 128.0 -> 129.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 54.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=64.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.125, (2, 1): 0.84375, (2, 2): 0.03125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.125, (2, 1): 0.84375, (2, 2): 0.03125}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 54.0}
in get_filtered_urn(filter=1) --- total: total=66.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.15151515151515152, (1, 1): 0.030303030303030304, (1, 2): 0.8181818181818182}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.15151515151515152, (1, 1): 0.030303030303030304, (1, 2): 0.8181818181818182}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 54.0 -> 55.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 54.0 -> 55.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 75.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=80.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9375, (2, 1): 0.05, (2, 2): 0.0125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9375, (2, 1): 0.05, (2, 2): 0.0125}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 75.0}
in get_filtered_urn(filter=0) --- total: total=77.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012987012987012988, (0, 1): 0.012987012987012988, (0, 2): 0.974025974025974}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.012987012987012988, (0, 1): 0.012987012987012988, (0, 2): 0.974025974025974}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 75.0 -> 76.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 75.0 -> 76.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 55.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=65.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.12307692307692308, (2, 1): 0.8461538461538461, (2, 2): 0.03076923076923077}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.12307692307692308, (2, 1): 0.8461538461538461, (2, 2): 0.03076923076923077}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 55.0}
in get_filtered_urn(filter=1) --- total: total=67.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.14925373134328357, (1, 1): 0.029850746268656716, (1, 2): 0.8208955223880597}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.14925373134328357, (1, 1): 0.029850746268656716, (1, 2): 0.8208955223880597}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 55.0 -> 55.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 86.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=88.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011363636363636364, (0, 1): 0.9772727272727273, (0, 2): 0.011363636363636364}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011363636363636364, (0, 1): 0.9772727272727273, (0, 2): 0.011363636363636364}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 86.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=91.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.945054945054945, (1, 1): 0.01098901098901099, (1, 2): 0.04395604395604396}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.945054945054945, (1, 1): 0.01098901098901099, (1, 2): 0.04395604395604396}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 86.0 -> 87.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 86.0 -> 87.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 61.0}
in get_filtered_urn(filter=0) --- total: total=73.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0273972602739726, (0, 1): 0.136986301369863, (0, 2): 0.8356164383561644}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0273972602739726, (0, 1): 0.136986301369863, (0, 2): 0.8356164383561644}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 61.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=67.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9104477611940298, (2, 1): 0.05970149253731343, (2, 2): 0.029850746268656716}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9104477611940298, (2, 1): 0.05970149253731343, (2, 2): 0.029850746268656716}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 61.0 -> 62.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 61.0 -> 62.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 76.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=81.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9382716049382716, (2, 1): 0.04938271604938271, (2, 2): 0.012345679012345678}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9382716049382716, (2, 1): 0.04938271604938271, (2, 2): 0.012345679012345678}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 76.0}
in get_filtered_urn(filter=0) --- total: total=78.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01282051282051282, (0, 1): 0.01282051282051282, (0, 2): 0.9743589743589743}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.01282051282051282, (0, 1): 0.01282051282051282, (0, 2): 0.9743589743589743}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 76.0 -> 77.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 76.0 -> 77.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 64.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=70.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9142857142857143, (1, 1): 0.02857142857142857, (1, 2): 0.05714285714285714}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9142857142857143, (1, 1): 0.02857142857142857, (1, 2): 0.05714285714285714}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 64.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=74.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02702702702702703, (0, 1): 0.8648648648648649, (0, 2): 0.10810810810810811}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.02702702702702703, (0, 1): 0.8648648648648649, (0, 2): 0.10810810810810811}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 64.0 -> 65.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 64.0 -> 65.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 77.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=82.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9390243902439024, (2, 1): 0.04878048780487805, (2, 2): 0.012195121951219513}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.9390243902439024, (2, 1): 0.04878048780487805, (2, 2): 0.012195121951219513}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 87.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=92.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9456521739130435, (1, 1): 0.010869565217391304, (1, 2): 0.043478260869565216}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9456521739130435, (1, 1): 0.010869565217391304, (1, 2): 0.043478260869565216}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 1): 4.0 -> 4.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 0): 87.0 -> 87.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 55.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=65.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.12307692307692308, (2, 1): 0.8461538461538461, (2, 2): 0.03076923076923077}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.12307692307692308, (2, 1): 0.8461538461538461, (2, 2): 0.03076923076923077}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 55.0}
in get_filtered_urn(filter=1) --- total: total=67.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.14925373134328357, (1, 1): 0.029850746268656716, (1, 2): 0.8208955223880597}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.14925373134328357, (1, 1): 0.029850746268656716, (1, 2): 0.8208955223880597}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 55.0 -> 56.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 55.0 -> 56.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 87.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=89.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011235955056179775, (0, 1): 0.9775280898876404, (0, 2): 0.011235955056179775}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011235955056179775, (0, 1): 0.9775280898876404, (0, 2): 0.011235955056179775}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 87.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=92.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9456521739130435, (1, 1): 0.010869565217391304, (1, 2): 0.043478260869565216}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9456521739130435, (1, 1): 0.010869565217391304, (1, 2): 0.043478260869565216}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 87.0 -> 88.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 87.0 -> 88.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 65.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=71.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9154929577464789, (1, 1): 0.028169014084507043, (1, 2): 0.056338028169014086}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.9154929577464789, (1, 1): 0.028169014084507043, (1, 2): 0.056338028169014086}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 62.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=68.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9117647058823529, (2, 1): 0.058823529411764705, (2, 2): 0.029411764705882353}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9117647058823529, (2, 1): 0.058823529411764705, (2, 2): 0.029411764705882353}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 62.0 -> 62.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 129.0}
in get_filtered_urn(filter=1) --- total: total=131.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.007633587786259542, (1, 1): 0.007633587786259542, (1, 2): 0.9847328244274809}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.007633587786259542, (1, 1): 0.007633587786259542, (1, 2): 0.9847328244274809}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 129.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=131.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.007633587786259542, (2, 1): 0.9847328244274809, (2, 2): 0.007633587786259542}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.007633587786259542, (2, 1): 0.9847328244274809, (2, 2): 0.007633587786259542}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 129.0 -> 130.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 129.0 -> 130.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 62.0}
in get_filtered_urn(filter=0) --- total: total=74.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02702702702702703, (0, 1): 0.13513513513513514, (0, 2): 0.8378378378378378}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02702702702702703, (0, 1): 0.13513513513513514, (0, 2): 0.8378378378378378}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 62.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=68.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9117647058823529, (2, 1): 0.058823529411764705, (2, 2): 0.029411764705882353}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.9117647058823529, (2, 1): 0.058823529411764705, (2, 2): 0.029411764705882353}
in decode_message(signal=2) Receiver 5 got option: (2, 1) and decoded action: 1
Receiver 5 received signals: [2] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 2): 62.0 -> 62.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 1): 4.0 -> 4.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 77.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=82.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9390243902439024, (2, 1): 0.04878048780487805, (2, 2): 0.012195121951219513}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9390243902439024, (2, 1): 0.04878048780487805, (2, 2): 0.012195121951219513}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 77.0}
in get_filtered_urn(filter=0) --- total: total=79.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012658227848101266, (0, 1): 0.012658227848101266, (0, 2): 0.9746835443037974}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.012658227848101266, (0, 1): 0.012658227848101266, (0, 2): 0.9746835443037974}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 77.0 -> 78.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 77.0 -> 78.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 62.0}
in get_filtered_urn(filter=0) --- total: total=74.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02702702702702703, (0, 1): 0.13513513513513514, (0, 2): 0.8378378378378378}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02702702702702703, (0, 1): 0.13513513513513514, (0, 2): 0.8378378378378378}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 62.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=68.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9117647058823529, (2, 1): 0.058823529411764705, (2, 2): 0.029411764705882353}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.9117647058823529, (2, 1): 0.058823529411764705, (2, 2): 0.029411764705882353}
in decode_message(signal=2) Receiver 5 got option: (2, 2) and decoded action: 2
Receiver 5 received signals: [2] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 2): 62.0 -> 62.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 78.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=83.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9397590361445783, (2, 1): 0.04819277108433735, (2, 2): 0.012048192771084338}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9397590361445783, (2, 1): 0.04819277108433735, (2, 2): 0.012048192771084338}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 78.0}
in get_filtered_urn(filter=0) --- total: total=80.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0125, (0, 1): 0.0125, (0, 2): 0.975}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0125, (0, 1): 0.0125, (0, 2): 0.975}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 78.0 -> 79.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 78.0 -> 79.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 62.0}
in get_filtered_urn(filter=0) --- total: total=74.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02702702702702703, (0, 1): 0.13513513513513514, (0, 2): 0.8378378378378378}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02702702702702703, (0, 1): 0.13513513513513514, (0, 2): 0.8378378378378378}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 62.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=68.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9117647058823529, (2, 1): 0.058823529411764705, (2, 2): 0.029411764705882353}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9117647058823529, (2, 1): 0.058823529411764705, (2, 2): 0.029411764705882353}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 62.0 -> 63.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 62.0 -> 63.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 79.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=84.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9404761904761905, (2, 1): 0.047619047619047616, (2, 2): 0.011904761904761904}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9404761904761905, (2, 1): 0.047619047619047616, (2, 2): 0.011904761904761904}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 79.0}
in get_filtered_urn(filter=0) --- total: total=81.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012345679012345678, (0, 1): 0.012345679012345678, (0, 2): 0.9753086419753086}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.012345679012345678, (0, 1): 0.012345679012345678, (0, 2): 0.9753086419753086}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 79.0 -> 80.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 79.0 -> 80.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 63.0}
in get_filtered_urn(filter=0) --- total: total=75.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02666666666666667, (0, 1): 0.13333333333333333, (0, 2): 0.84}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02666666666666667, (0, 1): 0.13333333333333333, (0, 2): 0.84}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 63.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=69.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9130434782608695, (2, 1): 0.057971014492753624, (2, 2): 0.028985507246376812}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9130434782608695, (2, 1): 0.057971014492753624, (2, 2): 0.028985507246376812}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 63.0 -> 64.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 63.0 -> 64.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 88.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=90.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011111111111111112, (0, 1): 0.9777777777777777, (0, 2): 0.011111111111111112}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011111111111111112, (0, 1): 0.9777777777777777, (0, 2): 0.011111111111111112}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 88.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=93.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.946236559139785, (1, 1): 0.010752688172043012, (1, 2): 0.043010752688172046}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.946236559139785, (1, 1): 0.010752688172043012, (1, 2): 0.043010752688172046}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 88.0 -> 89.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 88.0 -> 89.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 64.0}
in get_filtered_urn(filter=0) --- total: total=76.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02631578947368421, (0, 1): 0.13157894736842105, (0, 2): 0.8421052631578947}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02631578947368421, (0, 1): 0.13157894736842105, (0, 2): 0.8421052631578947}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 64.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=70.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9142857142857143, (2, 1): 0.05714285714285714, (2, 2): 0.02857142857142857}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9142857142857143, (2, 1): 0.05714285714285714, (2, 2): 0.02857142857142857}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 64.0 -> 65.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 64.0 -> 65.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 130.0}
in get_filtered_urn(filter=1) --- total: total=132.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.007575757575757576, (1, 1): 0.007575757575757576, (1, 2): 0.9848484848484849}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.007575757575757576, (1, 1): 0.007575757575757576, (1, 2): 0.9848484848484849}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 130.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=132.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.007575757575757576, (2, 1): 0.9848484848484849, (2, 2): 0.007575757575757576}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.007575757575757576, (2, 1): 0.9848484848484849, (2, 2): 0.007575757575757576}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 130.0 -> 131.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 130.0 -> 131.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 65.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=71.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9154929577464789, (1, 1): 0.028169014084507043, (1, 2): 0.056338028169014086}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9154929577464789, (1, 1): 0.028169014084507043, (1, 2): 0.056338028169014086}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 65.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=75.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02666666666666667, (0, 1): 0.8666666666666667, (0, 2): 0.10666666666666667}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.02666666666666667, (0, 1): 0.8666666666666667, (0, 2): 0.10666666666666667}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 65.0 -> 66.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 65.0 -> 66.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 80.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=85.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9411764705882353, (2, 1): 0.047058823529411764, (2, 2): 0.011764705882352941}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9411764705882353, (2, 1): 0.047058823529411764, (2, 2): 0.011764705882352941}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 80.0}
in get_filtered_urn(filter=0) --- total: total=82.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012195121951219513, (0, 1): 0.012195121951219513, (0, 2): 0.975609756097561}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.012195121951219513, (0, 1): 0.012195121951219513, (0, 2): 0.975609756097561}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 80.0 -> 81.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 80.0 -> 81.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 56.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=66.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.12121212121212122, (2, 1): 0.8484848484848485, (2, 2): 0.030303030303030304}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.12121212121212122, (2, 1): 0.8484848484848485, (2, 2): 0.030303030303030304}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 56.0}
in get_filtered_urn(filter=1) --- total: total=68.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.14705882352941177, (1, 1): 0.029411764705882353, (1, 2): 0.8235294117647058}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.14705882352941177, (1, 1): 0.029411764705882353, (1, 2): 0.8235294117647058}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 56.0 -> 57.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 56.0 -> 57.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 89.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=91.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01098901098901099, (0, 1): 0.978021978021978, (0, 2): 0.01098901098901099}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.01098901098901099, (0, 1): 0.978021978021978, (0, 2): 0.01098901098901099}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 89.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=94.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9468085106382979, (1, 1): 0.010638297872340425, (1, 2): 0.0425531914893617}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9468085106382979, (1, 1): 0.010638297872340425, (1, 2): 0.0425531914893617}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 89.0 -> 90.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 89.0 -> 90.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 66.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=72.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9166666666666666, (1, 1): 0.027777777777777776, (1, 2): 0.05555555555555555}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9166666666666666, (1, 1): 0.027777777777777776, (1, 2): 0.05555555555555555}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 66.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=76.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02631578947368421, (0, 1): 0.868421052631579, (0, 2): 0.10526315789473684}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.02631578947368421, (0, 1): 0.868421052631579, (0, 2): 0.10526315789473684}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 66.0 -> 67.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 66.0 -> 67.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 90.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=92.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010869565217391304, (0, 1): 0.9782608695652174, (0, 2): 0.010869565217391304}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.010869565217391304, (0, 1): 0.9782608695652174, (0, 2): 0.010869565217391304}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 90.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=95.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9473684210526315, (1, 1): 0.010526315789473684, (1, 2): 0.042105263157894736}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9473684210526315, (1, 1): 0.010526315789473684, (1, 2): 0.042105263157894736}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 90.0 -> 91.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 90.0 -> 91.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 67.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=73.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9178082191780822, (1, 1): 0.0273972602739726, (1, 2): 0.0547945205479452}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9178082191780822, (1, 1): 0.0273972602739726, (1, 2): 0.0547945205479452}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 67.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=77.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.025974025974025976, (0, 1): 0.8701298701298701, (0, 2): 0.1038961038961039}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.025974025974025976, (0, 1): 0.8701298701298701, (0, 2): 0.1038961038961039}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 67.0 -> 68.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 67.0 -> 68.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 91.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=93.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010752688172043012, (0, 1): 0.978494623655914, (0, 2): 0.010752688172043012}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.010752688172043012, (0, 1): 0.978494623655914, (0, 2): 0.010752688172043012}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 91.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=96.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9479166666666666, (1, 1): 0.010416666666666666, (1, 2): 0.041666666666666664}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9479166666666666, (1, 1): 0.010416666666666666, (1, 2): 0.041666666666666664}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 91.0 -> 92.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 91.0 -> 92.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 57.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=67.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.11940298507462686, (2, 1): 0.8507462686567164, (2, 2): 0.029850746268656716}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.11940298507462686, (2, 1): 0.8507462686567164, (2, 2): 0.029850746268656716}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 57.0}
in get_filtered_urn(filter=1) --- total: total=69.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.14492753623188406, (1, 1): 0.028985507246376812, (1, 2): 0.8260869565217391}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.14492753623188406, (1, 1): 0.028985507246376812, (1, 2): 0.8260869565217391}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 57.0 -> 58.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 57.0 -> 58.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 92.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=94.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010638297872340425, (0, 1): 0.9787234042553191, (0, 2): 0.010638297872340425}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.010638297872340425, (0, 1): 0.9787234042553191, (0, 2): 0.010638297872340425}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 92.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=97.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9484536082474226, (1, 1): 0.010309278350515464, (1, 2): 0.041237113402061855}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9484536082474226, (1, 1): 0.010309278350515464, (1, 2): 0.041237113402061855}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 92.0 -> 93.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 92.0 -> 93.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 58.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=68.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.11764705882352941, (2, 1): 0.8529411764705882, (2, 2): 0.029411764705882353}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.11764705882352941, (2, 1): 0.8529411764705882, (2, 2): 0.029411764705882353}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 58.0}
in get_filtered_urn(filter=1) --- total: total=70.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.14285714285714285, (1, 1): 0.02857142857142857, (1, 2): 0.8285714285714286}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.14285714285714285, (1, 1): 0.02857142857142857, (1, 2): 0.8285714285714286}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 58.0 -> 58.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 81.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=86.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9418604651162791, (2, 1): 0.046511627906976744, (2, 2): 0.011627906976744186}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9418604651162791, (2, 1): 0.046511627906976744, (2, 2): 0.011627906976744186}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 81.0}
in get_filtered_urn(filter=0) --- total: total=83.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012048192771084338, (0, 1): 0.012048192771084338, (0, 2): 0.9759036144578314}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.012048192771084338, (0, 1): 0.012048192771084338, (0, 2): 0.9759036144578314}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 81.0 -> 82.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 81.0 -> 82.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 65.0}
in get_filtered_urn(filter=0) --- total: total=77.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.025974025974025976, (0, 1): 0.12987012987012986, (0, 2): 0.8441558441558441}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.025974025974025976, (0, 1): 0.12987012987012986, (0, 2): 0.8441558441558441}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 65.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=71.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9154929577464789, (2, 1): 0.056338028169014086, (2, 2): 0.028169014084507043}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9154929577464789, (2, 1): 0.056338028169014086, (2, 2): 0.028169014084507043}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 65.0 -> 66.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 65.0 -> 66.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 131.0}
in get_filtered_urn(filter=1) --- total: total=133.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.007518796992481203, (1, 1): 0.007518796992481203, (1, 2): 0.9849624060150376}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.007518796992481203, (1, 1): 0.007518796992481203, (1, 2): 0.9849624060150376}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 131.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=133.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.007518796992481203, (2, 1): 0.9849624060150376, (2, 2): 0.007518796992481203}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.007518796992481203, (2, 1): 0.9849624060150376, (2, 2): 0.007518796992481203}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 131.0 -> 132.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 131.0 -> 132.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 68.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=74.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.918918918918919, (1, 1): 0.02702702702702703, (1, 2): 0.05405405405405406}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.918918918918919, (1, 1): 0.02702702702702703, (1, 2): 0.05405405405405406}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 68.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=78.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02564102564102564, (0, 1): 0.8717948717948718, (0, 2): 0.10256410256410256}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.02564102564102564, (0, 1): 0.8717948717948718, (0, 2): 0.10256410256410256}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 68.0 -> 69.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 68.0 -> 69.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 132.0}
in get_filtered_urn(filter=1) --- total: total=134.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.007462686567164179, (1, 1): 0.007462686567164179, (1, 2): 0.9850746268656716}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.007462686567164179, (1, 1): 0.007462686567164179, (1, 2): 0.9850746268656716}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 132.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=134.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.007462686567164179, (2, 1): 0.9850746268656716, (2, 2): 0.007462686567164179}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.007462686567164179, (2, 1): 0.9850746268656716, (2, 2): 0.007462686567164179}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 132.0 -> 133.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 132.0 -> 133.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 69.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=75.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.92, (1, 1): 0.02666666666666667, (1, 2): 0.05333333333333334}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.92, (1, 1): 0.02666666666666667, (1, 2): 0.05333333333333334}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 69.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=79.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02531645569620253, (0, 1): 0.8734177215189873, (0, 2): 0.10126582278481013}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.02531645569620253, (0, 1): 0.8734177215189873, (0, 2): 0.10126582278481013}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 69.0 -> 70.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 69.0 -> 70.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 133.0}
in get_filtered_urn(filter=1) --- total: total=135.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.007407407407407408, (1, 1): 0.007407407407407408, (1, 2): 0.9851851851851852}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.007407407407407408, (1, 1): 0.007407407407407408, (1, 2): 0.9851851851851852}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 133.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=135.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.007407407407407408, (2, 1): 0.9851851851851852, (2, 2): 0.007407407407407408}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.007407407407407408, (2, 1): 0.9851851851851852, (2, 2): 0.007407407407407408}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 133.0 -> 134.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 133.0 -> 134.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 70.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=76.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9210526315789473, (1, 1): 0.02631578947368421, (1, 2): 0.05263157894736842}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9210526315789473, (1, 1): 0.02631578947368421, (1, 2): 0.05263157894736842}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 70.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=80.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.025, (0, 1): 0.875, (0, 2): 0.1}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.025, (0, 1): 0.875, (0, 2): 0.1}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 70.0 -> 70.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 8.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 93.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=95.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010526315789473684, (0, 1): 0.9789473684210527, (0, 2): 0.010526315789473684}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.010526315789473684, (0, 1): 0.9789473684210527, (0, 2): 0.010526315789473684}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 93.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=98.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9489795918367347, (1, 1): 0.01020408163265306, (1, 2): 0.04081632653061224}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.9489795918367347, (1, 1): 0.01020408163265306, (1, 2): 0.04081632653061224}
in decode_message(signal=1) Receiver 2 got option: (1, 2) and decoded action: 2
Receiver 2 received signals: [1] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 1): 93.0 -> 93.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 58.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=68.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.11764705882352941, (2, 1): 0.8529411764705882, (2, 2): 0.029411764705882353}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.11764705882352941, (2, 1): 0.8529411764705882, (2, 2): 0.029411764705882353}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 58.0}
in get_filtered_urn(filter=1) --- total: total=70.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.14285714285714285, (1, 1): 0.02857142857142857, (1, 2): 0.8285714285714286}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.14285714285714285, (1, 1): 0.02857142857142857, (1, 2): 0.8285714285714286}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 58.0 -> 59.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 58.0 -> 59.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 134.0}
in get_filtered_urn(filter=1) --- total: total=136.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.007352941176470588, (1, 1): 0.007352941176470588, (1, 2): 0.9852941176470589}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.007352941176470588, (1, 1): 0.007352941176470588, (1, 2): 0.9852941176470589}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 134.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=136.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.007352941176470588, (2, 1): 0.9852941176470589, (2, 2): 0.007352941176470588}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.007352941176470588, (2, 1): 0.9852941176470589, (2, 2): 0.007352941176470588}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 134.0 -> 135.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 134.0 -> 135.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 66.0}
in get_filtered_urn(filter=0) --- total: total=78.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02564102564102564, (0, 1): 0.1282051282051282, (0, 2): 0.8461538461538461}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02564102564102564, (0, 1): 0.1282051282051282, (0, 2): 0.8461538461538461}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 66.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=72.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9166666666666666, (2, 1): 0.05555555555555555, (2, 2): 0.027777777777777776}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9166666666666666, (2, 1): 0.05555555555555555, (2, 2): 0.027777777777777776}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 66.0 -> 67.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 66.0 -> 67.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 82.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=87.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9425287356321839, (2, 1): 0.04597701149425287, (2, 2): 0.011494252873563218}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9425287356321839, (2, 1): 0.04597701149425287, (2, 2): 0.011494252873563218}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 82.0}
in get_filtered_urn(filter=0) --- total: total=84.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011904761904761904, (0, 1): 0.011904761904761904, (0, 2): 0.9761904761904762}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.011904761904761904, (0, 1): 0.011904761904761904, (0, 2): 0.9761904761904762}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 82.0 -> 83.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 82.0 -> 83.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 59.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=69.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.11594202898550725, (2, 1): 0.855072463768116, (2, 2): 0.028985507246376812}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.11594202898550725, (2, 1): 0.855072463768116, (2, 2): 0.028985507246376812}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 59.0}
in get_filtered_urn(filter=1) --- total: total=71.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.14084507042253522, (1, 1): 0.028169014084507043, (1, 2): 0.8309859154929577}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.14084507042253522, (1, 1): 0.028169014084507043, (1, 2): 0.8309859154929577}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 59.0 -> 60.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 59.0 -> 60.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 93.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=95.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010526315789473684, (0, 1): 0.9789473684210527, (0, 2): 0.010526315789473684}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.010526315789473684, (0, 1): 0.9789473684210527, (0, 2): 0.010526315789473684}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 93.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=98.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9489795918367347, (1, 1): 0.01020408163265306, (1, 2): 0.04081632653061224}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9489795918367347, (1, 1): 0.01020408163265306, (1, 2): 0.04081632653061224}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 93.0 -> 94.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 93.0 -> 94.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 60.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=70.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.11428571428571428, (2, 1): 0.8571428571428571, (2, 2): 0.02857142857142857}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.11428571428571428, (2, 1): 0.8571428571428571, (2, 2): 0.02857142857142857}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 60.0}
in get_filtered_urn(filter=1) --- total: total=72.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.1388888888888889, (1, 1): 0.027777777777777776, (1, 2): 0.8333333333333334}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.1388888888888889, (1, 1): 0.027777777777777776, (1, 2): 0.8333333333333334}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 60.0 -> 61.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 60.0 -> 61.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 83.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=88.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9431818181818182, (2, 1): 0.045454545454545456, (2, 2): 0.011363636363636364}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9431818181818182, (2, 1): 0.045454545454545456, (2, 2): 0.011363636363636364}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 83.0}
in get_filtered_urn(filter=0) --- total: total=85.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011764705882352941, (0, 1): 0.011764705882352941, (0, 2): 0.9764705882352941}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.011764705882352941, (0, 1): 0.011764705882352941, (0, 2): 0.9764705882352941}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 83.0 -> 84.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 83.0 -> 84.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 70.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=76.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9210526315789473, (1, 1): 0.02631578947368421, (1, 2): 0.05263157894736842}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9210526315789473, (1, 1): 0.02631578947368421, (1, 2): 0.05263157894736842}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 70.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=80.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.025, (0, 1): 0.875, (0, 2): 0.1}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.025, (0, 1): 0.875, (0, 2): 0.1}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 70.0 -> 71.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 70.0 -> 71.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 135.0}
in get_filtered_urn(filter=1) --- total: total=137.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0072992700729927005, (1, 1): 0.0072992700729927005, (1, 2): 0.9854014598540146}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0072992700729927005, (1, 1): 0.0072992700729927005, (1, 2): 0.9854014598540146}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 135.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=137.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0072992700729927005, (2, 1): 0.9854014598540146, (2, 2): 0.0072992700729927005}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0072992700729927005, (2, 1): 0.9854014598540146, (2, 2): 0.0072992700729927005}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 135.0 -> 136.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 135.0 -> 136.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 71.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=77.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.922077922077922, (1, 1): 0.025974025974025976, (1, 2): 0.05194805194805195}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.922077922077922, (1, 1): 0.025974025974025976, (1, 2): 0.05194805194805195}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 71.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=81.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.024691358024691357, (0, 1): 0.8765432098765432, (0, 2): 0.09876543209876543}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.024691358024691357, (0, 1): 0.8765432098765432, (0, 2): 0.09876543209876543}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 71.0 -> 72.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 71.0 -> 72.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 84.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=89.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9438202247191011, (2, 1): 0.0449438202247191, (2, 2): 0.011235955056179775}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9438202247191011, (2, 1): 0.0449438202247191, (2, 2): 0.011235955056179775}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 84.0}
in get_filtered_urn(filter=0) --- total: total=86.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011627906976744186, (0, 1): 0.011627906976744186, (0, 2): 0.9767441860465116}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.011627906976744186, (0, 1): 0.011627906976744186, (0, 2): 0.9767441860465116}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 84.0 -> 85.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 84.0 -> 85.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 67.0}
in get_filtered_urn(filter=0) --- total: total=79.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02531645569620253, (0, 1): 0.12658227848101267, (0, 2): 0.8481012658227848}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02531645569620253, (0, 1): 0.12658227848101267, (0, 2): 0.8481012658227848}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 67.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=73.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9178082191780822, (2, 1): 0.0547945205479452, (2, 2): 0.0273972602739726}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9178082191780822, (2, 1): 0.0547945205479452, (2, 2): 0.0273972602739726}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 67.0 -> 68.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 67.0 -> 68.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 136.0}
in get_filtered_urn(filter=1) --- total: total=138.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.007246376811594203, (1, 1): 0.007246376811594203, (1, 2): 0.9855072463768116}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.007246376811594203, (1, 1): 0.007246376811594203, (1, 2): 0.9855072463768116}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 136.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=138.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.007246376811594203, (2, 1): 0.9855072463768116, (2, 2): 0.007246376811594203}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.007246376811594203, (2, 1): 0.9855072463768116, (2, 2): 0.007246376811594203}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 136.0 -> 137.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 136.0 -> 137.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 61.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=71.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.11267605633802817, (2, 1): 0.8591549295774648, (2, 2): 0.028169014084507043}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.11267605633802817, (2, 1): 0.8591549295774648, (2, 2): 0.028169014084507043}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 61.0}
in get_filtered_urn(filter=1) --- total: total=73.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.136986301369863, (1, 1): 0.0273972602739726, (1, 2): 0.8356164383561644}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.136986301369863, (1, 1): 0.0273972602739726, (1, 2): 0.8356164383561644}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 61.0 -> 62.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 61.0 -> 62.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 137.0}
in get_filtered_urn(filter=1) --- total: total=139.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.007194244604316547, (1, 1): 0.007194244604316547, (1, 2): 0.9856115107913669}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.007194244604316547, (1, 1): 0.007194244604316547, (1, 2): 0.9856115107913669}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 137.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=139.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.007194244604316547, (2, 1): 0.9856115107913669, (2, 2): 0.007194244604316547}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.007194244604316547, (2, 1): 0.9856115107913669, (2, 2): 0.007194244604316547}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 137.0 -> 138.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 137.0 -> 138.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 62.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=72.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.1111111111111111, (2, 1): 0.8611111111111112, (2, 2): 0.027777777777777776}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.1111111111111111, (2, 1): 0.8611111111111112, (2, 2): 0.027777777777777776}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 62.0}
in get_filtered_urn(filter=1) --- total: total=74.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.13513513513513514, (1, 1): 0.02702702702702703, (1, 2): 0.8378378378378378}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.13513513513513514, (1, 1): 0.02702702702702703, (1, 2): 0.8378378378378378}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 62.0 -> 63.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 62.0 -> 63.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 138.0}
in get_filtered_urn(filter=1) --- total: total=140.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.007142857142857143, (1, 1): 0.007142857142857143, (1, 2): 0.9857142857142858}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.007142857142857143, (1, 1): 0.007142857142857143, (1, 2): 0.9857142857142858}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 138.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=140.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.007142857142857143, (2, 1): 0.9857142857142858, (2, 2): 0.007142857142857143}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.007142857142857143, (2, 1): 0.9857142857142858, (2, 2): 0.007142857142857143}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 138.0 -> 139.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 138.0 -> 139.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 68.0}
in get_filtered_urn(filter=0) --- total: total=80.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.025, (0, 1): 0.125, (0, 2): 0.85}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.025, (0, 1): 0.125, (0, 2): 0.85}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 68.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=74.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.918918918918919, (2, 1): 0.05405405405405406, (2, 2): 0.02702702702702703}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.918918918918919, (2, 1): 0.05405405405405406, (2, 2): 0.02702702702702703}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 68.0 -> 69.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 68.0 -> 69.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 139.0}
in get_filtered_urn(filter=1) --- total: total=141.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0070921985815602835, (1, 1): 0.0070921985815602835, (1, 2): 0.9858156028368794}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0070921985815602835, (1, 1): 0.0070921985815602835, (1, 2): 0.9858156028368794}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 139.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=141.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0070921985815602835, (2, 1): 0.9858156028368794, (2, 2): 0.0070921985815602835}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0070921985815602835, (2, 1): 0.9858156028368794, (2, 2): 0.0070921985815602835}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 139.0 -> 140.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 139.0 -> 140.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 72.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=78.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9230769230769231, (1, 1): 0.02564102564102564, (1, 2): 0.05128205128205128}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9230769230769231, (1, 1): 0.02564102564102564, (1, 2): 0.05128205128205128}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 72.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=82.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.024390243902439025, (0, 1): 0.8780487804878049, (0, 2): 0.0975609756097561}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.024390243902439025, (0, 1): 0.8780487804878049, (0, 2): 0.0975609756097561}
in decode_message(signal=0) Receiver 5 got option: (0, 0) and decoded action: 0
Receiver 5 received signals: [0] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 72.0 -> 72.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 0): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 94.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=96.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010416666666666666, (0, 1): 0.9791666666666666, (0, 2): 0.010416666666666666}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.010416666666666666, (0, 1): 0.9791666666666666, (0, 2): 0.010416666666666666}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 94.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=99.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9494949494949495, (1, 1): 0.010101010101010102, (1, 2): 0.04040404040404041}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9494949494949495, (1, 1): 0.010101010101010102, (1, 2): 0.04040404040404041}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 94.0 -> 95.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 94.0 -> 95.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 72.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=78.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9230769230769231, (1, 1): 0.02564102564102564, (1, 2): 0.05128205128205128}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.9230769230769231, (1, 1): 0.02564102564102564, (1, 2): 0.05128205128205128}
Sender 4 got filter 1 choose option: (1, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 63.0}
in get_filtered_urn(filter=1) --- total: total=75.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.13333333333333333, (1, 1): 0.02666666666666667, (1, 2): 0.84}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.13333333333333333, (1, 1): 0.02666666666666667, (1, 2): 0.84}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 1): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 63.0 -> 63.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 140.0}
in get_filtered_urn(filter=1) --- total: total=142.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.007042253521126761, (1, 1): 0.007042253521126761, (1, 2): 0.9859154929577465}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.007042253521126761, (1, 1): 0.007042253521126761, (1, 2): 0.9859154929577465}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 140.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=142.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.007042253521126761, (2, 1): 0.9859154929577465, (2, 2): 0.007042253521126761}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.007042253521126761, (2, 1): 0.9859154929577465, (2, 2): 0.007042253521126761}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 140.0 -> 141.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 140.0 -> 141.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 63.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=73.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.1095890410958904, (2, 1): 0.863013698630137, (2, 2): 0.0273972602739726}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.1095890410958904, (2, 1): 0.863013698630137, (2, 2): 0.0273972602739726}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 63.0}
in get_filtered_urn(filter=1) --- total: total=75.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.13333333333333333, (1, 1): 0.02666666666666667, (1, 2): 0.84}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.13333333333333333, (1, 1): 0.02666666666666667, (1, 2): 0.84}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 63.0 -> 63.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 95.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=97.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010309278350515464, (0, 1): 0.979381443298969, (0, 2): 0.010309278350515464}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.010309278350515464, (0, 1): 0.979381443298969, (0, 2): 0.010309278350515464}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 95.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=100.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.95, (1, 1): 0.01, (1, 2): 0.04}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.95, (1, 1): 0.01, (1, 2): 0.04}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 95.0 -> 96.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 95.0 -> 96.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 72.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=78.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9230769230769231, (1, 1): 0.02564102564102564, (1, 2): 0.05128205128205128}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9230769230769231, (1, 1): 0.02564102564102564, (1, 2): 0.05128205128205128}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 72.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=82.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.024390243902439025, (0, 1): 0.8780487804878049, (0, 2): 0.0975609756097561}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.024390243902439025, (0, 1): 0.8780487804878049, (0, 2): 0.0975609756097561}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 72.0 -> 72.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 8.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 141.0}
in get_filtered_urn(filter=1) --- total: total=143.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.006993006993006993, (1, 1): 0.006993006993006993, (1, 2): 0.986013986013986}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.006993006993006993, (1, 1): 0.006993006993006993, (1, 2): 0.986013986013986}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 141.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=143.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.006993006993006993, (2, 1): 0.986013986013986, (2, 2): 0.006993006993006993}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.006993006993006993, (2, 1): 0.986013986013986, (2, 2): 0.006993006993006993}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 141.0 -> 142.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 141.0 -> 142.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 72.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=78.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9230769230769231, (1, 1): 0.02564102564102564, (1, 2): 0.05128205128205128}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9230769230769231, (1, 1): 0.02564102564102564, (1, 2): 0.05128205128205128}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 72.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=82.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.024390243902439025, (0, 1): 0.8780487804878049, (0, 2): 0.0975609756097561}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.024390243902439025, (0, 1): 0.8780487804878049, (0, 2): 0.0975609756097561}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 72.0 -> 73.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 72.0 -> 73.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 85.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=90.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9444444444444444, (2, 1): 0.044444444444444446, (2, 2): 0.011111111111111112}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9444444444444444, (2, 1): 0.044444444444444446, (2, 2): 0.011111111111111112}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 85.0}
in get_filtered_urn(filter=0) --- total: total=87.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011494252873563218, (0, 1): 0.011494252873563218, (0, 2): 0.9770114942528736}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.011494252873563218, (0, 1): 0.011494252873563218, (0, 2): 0.9770114942528736}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 85.0 -> 86.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 85.0 -> 86.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 63.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=73.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.1095890410958904, (2, 1): 0.863013698630137, (2, 2): 0.0273972602739726}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.1095890410958904, (2, 1): 0.863013698630137, (2, 2): 0.0273972602739726}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 63.0}
in get_filtered_urn(filter=1) --- total: total=75.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.13333333333333333, (1, 1): 0.02666666666666667, (1, 2): 0.84}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.13333333333333333, (1, 1): 0.02666666666666667, (1, 2): 0.84}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 63.0 -> 64.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 63.0 -> 64.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 86.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=91.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.945054945054945, (2, 1): 0.04395604395604396, (2, 2): 0.01098901098901099}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.945054945054945, (2, 1): 0.04395604395604396, (2, 2): 0.01098901098901099}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 86.0}
in get_filtered_urn(filter=0) --- total: total=88.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011363636363636364, (0, 1): 0.011363636363636364, (0, 2): 0.9772727272727273}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.011363636363636364, (0, 1): 0.011363636363636364, (0, 2): 0.9772727272727273}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 86.0 -> 87.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 86.0 -> 87.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 73.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=79.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9240506329113924, (1, 1): 0.02531645569620253, (1, 2): 0.05063291139240506}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9240506329113924, (1, 1): 0.02531645569620253, (1, 2): 0.05063291139240506}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 73.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=83.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.024096385542168676, (0, 1): 0.8795180722891566, (0, 2): 0.0963855421686747}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.024096385542168676, (0, 1): 0.8795180722891566, (0, 2): 0.0963855421686747}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 73.0 -> 74.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 73.0 -> 74.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 142.0}
in get_filtered_urn(filter=1) --- total: total=144.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.006944444444444444, (1, 1): 0.006944444444444444, (1, 2): 0.9861111111111112}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.006944444444444444, (1, 1): 0.006944444444444444, (1, 2): 0.9861111111111112}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 142.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=144.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.006944444444444444, (2, 1): 0.9861111111111112, (2, 2): 0.006944444444444444}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.006944444444444444, (2, 1): 0.9861111111111112, (2, 2): 0.006944444444444444}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 142.0 -> 143.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 142.0 -> 143.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 74.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=80.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.925, (1, 1): 0.025, (1, 2): 0.05}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.925, (1, 1): 0.025, (1, 2): 0.05}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 74.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=84.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.023809523809523808, (0, 1): 0.8809523809523809, (0, 2): 0.09523809523809523}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.023809523809523808, (0, 1): 0.8809523809523809, (0, 2): 0.09523809523809523}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 74.0 -> 75.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 74.0 -> 75.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 96.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=98.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01020408163265306, (0, 1): 0.9795918367346939, (0, 2): 0.01020408163265306}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.01020408163265306, (0, 1): 0.9795918367346939, (0, 2): 0.01020408163265306}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 96.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=101.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9504950495049505, (1, 1): 0.009900990099009901, (1, 2): 0.039603960396039604}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9504950495049505, (1, 1): 0.009900990099009901, (1, 2): 0.039603960396039604}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 96.0 -> 97.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 96.0 -> 97.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 75.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=81.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9259259259259259, (1, 1): 0.024691358024691357, (1, 2): 0.04938271604938271}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9259259259259259, (1, 1): 0.024691358024691357, (1, 2): 0.04938271604938271}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 75.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=85.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.023529411764705882, (0, 1): 0.8823529411764706, (0, 2): 0.09411764705882353}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.023529411764705882, (0, 1): 0.8823529411764706, (0, 2): 0.09411764705882353}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 75.0 -> 76.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 75.0 -> 76.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 143.0}
in get_filtered_urn(filter=1) --- total: total=145.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.006896551724137931, (1, 1): 0.006896551724137931, (1, 2): 0.9862068965517241}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.006896551724137931, (1, 1): 0.006896551724137931, (1, 2): 0.9862068965517241}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 143.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=145.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.006896551724137931, (2, 1): 0.9862068965517241, (2, 2): 0.006896551724137931}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.006896551724137931, (2, 1): 0.9862068965517241, (2, 2): 0.006896551724137931}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 143.0 -> 144.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 143.0 -> 144.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 64.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=74.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.10810810810810811, (2, 1): 0.8648648648648649, (2, 2): 0.02702702702702703}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.10810810810810811, (2, 1): 0.8648648648648649, (2, 2): 0.02702702702702703}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 64.0}
in get_filtered_urn(filter=1) --- total: total=76.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.13157894736842105, (1, 1): 0.02631578947368421, (1, 2): 0.8421052631578947}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.13157894736842105, (1, 1): 0.02631578947368421, (1, 2): 0.8421052631578947}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 64.0 -> 65.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 64.0 -> 65.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 144.0}
in get_filtered_urn(filter=1) --- total: total=146.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.00684931506849315, (1, 1): 0.00684931506849315, (1, 2): 0.9863013698630136}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.00684931506849315, (1, 1): 0.00684931506849315, (1, 2): 0.9863013698630136}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 144.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=146.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.00684931506849315, (2, 1): 0.9863013698630136, (2, 2): 0.00684931506849315}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.00684931506849315, (2, 1): 0.9863013698630136, (2, 2): 0.00684931506849315}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 144.0 -> 145.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 144.0 -> 145.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 65.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=75.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.10666666666666667, (2, 1): 0.8666666666666667, (2, 2): 0.02666666666666667}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.10666666666666667, (2, 1): 0.8666666666666667, (2, 2): 0.02666666666666667}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 65.0}
in get_filtered_urn(filter=1) --- total: total=77.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.12987012987012986, (1, 1): 0.025974025974025976, (1, 2): 0.8441558441558441}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.12987012987012986, (1, 1): 0.025974025974025976, (1, 2): 0.8441558441558441}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 65.0 -> 66.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 65.0 -> 66.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 97.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=99.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010101010101010102, (0, 1): 0.9797979797979798, (0, 2): 0.010101010101010102}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.010101010101010102, (0, 1): 0.9797979797979798, (0, 2): 0.010101010101010102}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 97.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=102.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9509803921568627, (1, 1): 0.00980392156862745, (1, 2): 0.0392156862745098}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9509803921568627, (1, 1): 0.00980392156862745, (1, 2): 0.0392156862745098}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 97.0 -> 98.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 97.0 -> 98.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 69.0}
in get_filtered_urn(filter=0) --- total: total=81.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.024691358024691357, (0, 1): 0.12345679012345678, (0, 2): 0.8518518518518519}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.024691358024691357, (0, 1): 0.12345679012345678, (0, 2): 0.8518518518518519}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 69.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=75.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.92, (2, 1): 0.05333333333333334, (2, 2): 0.02666666666666667}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.92, (2, 1): 0.05333333333333334, (2, 2): 0.02666666666666667}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 69.0 -> 70.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 69.0 -> 70.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 87.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=92.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9456521739130435, (2, 1): 0.043478260869565216, (2, 2): 0.010869565217391304}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9456521739130435, (2, 1): 0.043478260869565216, (2, 2): 0.010869565217391304}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 87.0}
in get_filtered_urn(filter=0) --- total: total=89.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011235955056179775, (0, 1): 0.011235955056179775, (0, 2): 0.9775280898876404}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.011235955056179775, (0, 1): 0.011235955056179775, (0, 2): 0.9775280898876404}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 87.0 -> 88.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 87.0 -> 88.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 66.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=76.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.10526315789473684, (2, 1): 0.868421052631579, (2, 2): 0.02631578947368421}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.10526315789473684, (2, 1): 0.868421052631579, (2, 2): 0.02631578947368421}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 66.0}
in get_filtered_urn(filter=1) --- total: total=78.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.1282051282051282, (1, 1): 0.02564102564102564, (1, 2): 0.8461538461538461}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.1282051282051282, (1, 1): 0.02564102564102564, (1, 2): 0.8461538461538461}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 66.0 -> 67.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 66.0 -> 67.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 88.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=93.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.946236559139785, (2, 1): 0.043010752688172046, (2, 2): 0.010752688172043012}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.946236559139785, (2, 1): 0.043010752688172046, (2, 2): 0.010752688172043012}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 88.0}
in get_filtered_urn(filter=0) --- total: total=90.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011111111111111112, (0, 1): 0.011111111111111112, (0, 2): 0.9777777777777777}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.011111111111111112, (0, 1): 0.011111111111111112, (0, 2): 0.9777777777777777}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 88.0 -> 89.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 88.0 -> 89.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 67.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=77.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.1038961038961039, (2, 1): 0.8701298701298701, (2, 2): 0.025974025974025976}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.1038961038961039, (2, 1): 0.8701298701298701, (2, 2): 0.025974025974025976}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 67.0}
in get_filtered_urn(filter=1) --- total: total=79.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.12658227848101267, (1, 1): 0.02531645569620253, (1, 2): 0.8481012658227848}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.12658227848101267, (1, 1): 0.02531645569620253, (1, 2): 0.8481012658227848}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 67.0 -> 67.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 145.0}
in get_filtered_urn(filter=1) --- total: total=147.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.006802721088435374, (1, 1): 0.006802721088435374, (1, 2): 0.9863945578231292}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.006802721088435374, (1, 1): 0.006802721088435374, (1, 2): 0.9863945578231292}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 145.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=147.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.006802721088435374, (2, 1): 0.9863945578231292, (2, 2): 0.006802721088435374}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.006802721088435374, (2, 1): 0.9863945578231292, (2, 2): 0.006802721088435374}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 145.0 -> 146.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 145.0 -> 146.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 67.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=77.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.1038961038961039, (2, 1): 0.8701298701298701, (2, 2): 0.025974025974025976}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.1038961038961039, (2, 1): 0.8701298701298701, (2, 2): 0.025974025974025976}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 67.0}
in get_filtered_urn(filter=1) --- total: total=79.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.12658227848101267, (1, 1): 0.02531645569620253, (1, 2): 0.8481012658227848}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.12658227848101267, (1, 1): 0.02531645569620253, (1, 2): 0.8481012658227848}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 67.0 -> 68.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 67.0 -> 68.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 98.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=100.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01, (0, 1): 0.98, (0, 2): 0.01}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.01, (0, 1): 0.98, (0, 2): 0.01}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 98.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=103.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9514563106796117, (1, 1): 0.009708737864077669, (1, 2): 0.038834951456310676}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9514563106796117, (1, 1): 0.009708737864077669, (1, 2): 0.038834951456310676}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 98.0 -> 99.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 98.0 -> 99.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 76.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=82.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.926829268292683, (1, 1): 0.024390243902439025, (1, 2): 0.04878048780487805}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.926829268292683, (1, 1): 0.024390243902439025, (1, 2): 0.04878048780487805}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 76.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=86.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.023255813953488372, (0, 1): 0.8837209302325582, (0, 2): 0.09302325581395349}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.023255813953488372, (0, 1): 0.8837209302325582, (0, 2): 0.09302325581395349}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 76.0 -> 77.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 76.0 -> 77.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 89.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=94.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9468085106382979, (2, 1): 0.0425531914893617, (2, 2): 0.010638297872340425}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9468085106382979, (2, 1): 0.0425531914893617, (2, 2): 0.010638297872340425}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 89.0}
in get_filtered_urn(filter=0) --- total: total=91.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01098901098901099, (0, 1): 0.01098901098901099, (0, 2): 0.978021978021978}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.01098901098901099, (0, 1): 0.01098901098901099, (0, 2): 0.978021978021978}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 89.0 -> 90.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 89.0 -> 90.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 70.0}
in get_filtered_urn(filter=0) --- total: total=82.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.024390243902439025, (0, 1): 0.12195121951219512, (0, 2): 0.8536585365853658}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.024390243902439025, (0, 1): 0.12195121951219512, (0, 2): 0.8536585365853658}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 70.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=76.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9210526315789473, (2, 1): 0.05263157894736842, (2, 2): 0.02631578947368421}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9210526315789473, (2, 1): 0.05263157894736842, (2, 2): 0.02631578947368421}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 70.0 -> 71.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 70.0 -> 71.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 146.0}
in get_filtered_urn(filter=1) --- total: total=148.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.006756756756756757, (1, 1): 0.006756756756756757, (1, 2): 0.9864864864864865}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.006756756756756757, (1, 1): 0.006756756756756757, (1, 2): 0.9864864864864865}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 146.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=148.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.006756756756756757, (2, 1): 0.9864864864864865, (2, 2): 0.006756756756756757}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.006756756756756757, (2, 1): 0.9864864864864865, (2, 2): 0.006756756756756757}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 146.0 -> 147.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 146.0 -> 147.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 71.0}
in get_filtered_urn(filter=0) --- total: total=83.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.024096385542168676, (0, 1): 0.12048192771084337, (0, 2): 0.8554216867469879}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.024096385542168676, (0, 1): 0.12048192771084337, (0, 2): 0.8554216867469879}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 71.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=77.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.922077922077922, (2, 1): 0.05194805194805195, (2, 2): 0.025974025974025976}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.922077922077922, (2, 1): 0.05194805194805195, (2, 2): 0.025974025974025976}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 71.0 -> 72.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 71.0 -> 72.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 90.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=95.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9473684210526315, (2, 1): 0.042105263157894736, (2, 2): 0.010526315789473684}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9473684210526315, (2, 1): 0.042105263157894736, (2, 2): 0.010526315789473684}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 90.0}
in get_filtered_urn(filter=0) --- total: total=92.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010869565217391304, (0, 1): 0.010869565217391304, (0, 2): 0.9782608695652174}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010869565217391304, (0, 1): 0.010869565217391304, (0, 2): 0.9782608695652174}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 90.0 -> 91.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 90.0 -> 91.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 68.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=78.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.10256410256410256, (2, 1): 0.8717948717948718, (2, 2): 0.02564102564102564}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.10256410256410256, (2, 1): 0.8717948717948718, (2, 2): 0.02564102564102564}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 68.0}
in get_filtered_urn(filter=1) --- total: total=80.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.125, (1, 1): 0.025, (1, 2): 0.85}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.125, (1, 1): 0.025, (1, 2): 0.85}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 68.0 -> 69.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 68.0 -> 69.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 99.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=101.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009900990099009901, (0, 1): 0.9801980198019802, (0, 2): 0.009900990099009901}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009900990099009901, (0, 1): 0.9801980198019802, (0, 2): 0.009900990099009901}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 99.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=104.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9519230769230769, (1, 1): 0.009615384615384616, (1, 2): 0.038461538461538464}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9519230769230769, (1, 1): 0.009615384615384616, (1, 2): 0.038461538461538464}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 99.0 -> 100.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 99.0 -> 100.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 69.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=79.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.10126582278481013, (2, 1): 0.8734177215189873, (2, 2): 0.02531645569620253}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.10126582278481013, (2, 1): 0.8734177215189873, (2, 2): 0.02531645569620253}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 69.0}
in get_filtered_urn(filter=1) --- total: total=81.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.12345679012345678, (1, 1): 0.024691358024691357, (1, 2): 0.8518518518518519}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.12345679012345678, (1, 1): 0.024691358024691357, (1, 2): 0.8518518518518519}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 69.0 -> 70.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 69.0 -> 70.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 91.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=96.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9479166666666666, (2, 1): 0.041666666666666664, (2, 2): 0.010416666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.9479166666666666, (2, 1): 0.041666666666666664, (2, 2): 0.010416666666666666}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 100.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=105.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9523809523809523, (1, 1): 0.009523809523809525, (1, 2): 0.0380952380952381}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9523809523809523, (1, 1): 0.009523809523809525, (1, 2): 0.0380952380952381}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 1): 4.0 -> 4.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 0): 100.0 -> 100.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 72.0}
in get_filtered_urn(filter=0) --- total: total=84.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.023809523809523808, (0, 1): 0.11904761904761904, (0, 2): 0.8571428571428571}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.023809523809523808, (0, 1): 0.11904761904761904, (0, 2): 0.8571428571428571}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 72.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=78.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9230769230769231, (2, 1): 0.05128205128205128, (2, 2): 0.02564102564102564}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9230769230769231, (2, 1): 0.05128205128205128, (2, 2): 0.02564102564102564}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 72.0 -> 73.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 72.0 -> 73.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 147.0}
in get_filtered_urn(filter=1) --- total: total=149.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.006711409395973154, (1, 1): 0.006711409395973154, (1, 2): 0.9865771812080537}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.006711409395973154, (1, 1): 0.006711409395973154, (1, 2): 0.9865771812080537}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 147.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=149.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.006711409395973154, (2, 1): 0.9865771812080537, (2, 2): 0.006711409395973154}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.006711409395973154, (2, 1): 0.9865771812080537, (2, 2): 0.006711409395973154}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 147.0 -> 148.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 147.0 -> 148.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 73.0}
in get_filtered_urn(filter=0) --- total: total=85.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.023529411764705882, (0, 1): 0.11764705882352941, (0, 2): 0.8588235294117647}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.023529411764705882, (0, 1): 0.11764705882352941, (0, 2): 0.8588235294117647}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 73.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=79.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9240506329113924, (2, 1): 0.05063291139240506, (2, 2): 0.02531645569620253}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9240506329113924, (2, 1): 0.05063291139240506, (2, 2): 0.02531645569620253}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 73.0 -> 74.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 73.0 -> 74.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 148.0}
in get_filtered_urn(filter=1) --- total: total=150.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.006666666666666667, (1, 1): 0.006666666666666667, (1, 2): 0.9866666666666667}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.006666666666666667, (1, 1): 0.006666666666666667, (1, 2): 0.9866666666666667}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 148.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=150.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.006666666666666667, (2, 1): 0.9866666666666667, (2, 2): 0.006666666666666667}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.006666666666666667, (2, 1): 0.9866666666666667, (2, 2): 0.006666666666666667}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 148.0 -> 149.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 148.0 -> 149.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 77.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=83.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.927710843373494, (1, 1): 0.024096385542168676, (1, 2): 0.04819277108433735}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.927710843373494, (1, 1): 0.024096385542168676, (1, 2): 0.04819277108433735}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 77.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=87.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.022988505747126436, (0, 1): 0.8850574712643678, (0, 2): 0.09195402298850575}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.022988505747126436, (0, 1): 0.8850574712643678, (0, 2): 0.09195402298850575}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 77.0 -> 78.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 77.0 -> 78.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 91.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=96.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9479166666666666, (2, 1): 0.041666666666666664, (2, 2): 0.010416666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9479166666666666, (2, 1): 0.041666666666666664, (2, 2): 0.010416666666666666}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 91.0}
in get_filtered_urn(filter=0) --- total: total=93.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010752688172043012, (0, 1): 0.010752688172043012, (0, 2): 0.978494623655914}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010752688172043012, (0, 1): 0.010752688172043012, (0, 2): 0.978494623655914}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 91.0 -> 92.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 91.0 -> 92.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 70.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=80.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.1, (2, 1): 0.875, (2, 2): 0.025}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.1, (2, 1): 0.875, (2, 2): 0.025}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 70.0}
in get_filtered_urn(filter=1) --- total: total=82.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.12195121951219512, (1, 1): 0.024390243902439025, (1, 2): 0.8536585365853658}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.12195121951219512, (1, 1): 0.024390243902439025, (1, 2): 0.8536585365853658}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 70.0 -> 71.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 70.0 -> 71.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 92.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=97.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9484536082474226, (2, 1): 0.041237113402061855, (2, 2): 0.010309278350515464}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9484536082474226, (2, 1): 0.041237113402061855, (2, 2): 0.010309278350515464}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 92.0}
in get_filtered_urn(filter=0) --- total: total=94.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010638297872340425, (0, 1): 0.010638297872340425, (0, 2): 0.9787234042553191}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.010638297872340425, (0, 1): 0.010638297872340425, (0, 2): 0.9787234042553191}
in decode_message(signal=0) Receiver 2 got option: (0, 0) and decoded action: 0
Receiver 2 received signals: [0] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 0): 92.0 -> 92.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 0): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 71.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=81.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09876543209876543, (2, 1): 0.8765432098765432, (2, 2): 0.024691358024691357}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.09876543209876543, (2, 1): 0.8765432098765432, (2, 2): 0.024691358024691357}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 71.0}
in get_filtered_urn(filter=1) --- total: total=83.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.12048192771084337, (1, 1): 0.024096385542168676, (1, 2): 0.8554216867469879}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.12048192771084337, (1, 1): 0.024096385542168676, (1, 2): 0.8554216867469879}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 71.0 -> 72.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 71.0 -> 72.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 100.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=102.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00980392156862745, (0, 1): 0.9803921568627451, (0, 2): 0.00980392156862745}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00980392156862745, (0, 1): 0.9803921568627451, (0, 2): 0.00980392156862745}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 100.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=105.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9523809523809523, (1, 1): 0.009523809523809525, (1, 2): 0.0380952380952381}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9523809523809523, (1, 1): 0.009523809523809525, (1, 2): 0.0380952380952381}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 100.0 -> 101.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 100.0 -> 101.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 74.0}
in get_filtered_urn(filter=0) --- total: total=86.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.023255813953488372, (0, 1): 0.11627906976744186, (0, 2): 0.8604651162790697}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.023255813953488372, (0, 1): 0.11627906976744186, (0, 2): 0.8604651162790697}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 74.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=80.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.925, (2, 1): 0.05, (2, 2): 0.025}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.925, (2, 1): 0.05, (2, 2): 0.025}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 74.0 -> 75.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 74.0 -> 75.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 101.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=103.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009708737864077669, (0, 1): 0.9805825242718447, (0, 2): 0.009708737864077669}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009708737864077669, (0, 1): 0.9805825242718447, (0, 2): 0.009708737864077669}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 101.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=106.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9528301886792453, (1, 1): 0.009433962264150943, (1, 2): 0.03773584905660377}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9528301886792453, (1, 1): 0.009433962264150943, (1, 2): 0.03773584905660377}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 101.0 -> 102.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 101.0 -> 102.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 72.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=82.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0975609756097561, (2, 1): 0.8780487804878049, (2, 2): 0.024390243902439025}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0975609756097561, (2, 1): 0.8780487804878049, (2, 2): 0.024390243902439025}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 72.0}
in get_filtered_urn(filter=1) --- total: total=84.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.11904761904761904, (1, 1): 0.023809523809523808, (1, 2): 0.8571428571428571}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.11904761904761904, (1, 1): 0.023809523809523808, (1, 2): 0.8571428571428571}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 72.0 -> 73.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 72.0 -> 73.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 102.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=104.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009615384615384616, (0, 1): 0.9807692307692307, (0, 2): 0.009615384615384616}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009615384615384616, (0, 1): 0.9807692307692307, (0, 2): 0.009615384615384616}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 102.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=107.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9532710280373832, (1, 1): 0.009345794392523364, (1, 2): 0.037383177570093455}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9532710280373832, (1, 1): 0.009345794392523364, (1, 2): 0.037383177570093455}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 102.0 -> 103.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 102.0 -> 103.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 75.0}
in get_filtered_urn(filter=0) --- total: total=87.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.022988505747126436, (0, 1): 0.11494252873563218, (0, 2): 0.8620689655172413}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.022988505747126436, (0, 1): 0.11494252873563218, (0, 2): 0.8620689655172413}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 75.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=81.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9259259259259259, (2, 1): 0.04938271604938271, (2, 2): 0.024691358024691357}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9259259259259259, (2, 1): 0.04938271604938271, (2, 2): 0.024691358024691357}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 75.0 -> 76.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 75.0 -> 76.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 103.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=105.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009523809523809525, (0, 1): 0.9809523809523809, (0, 2): 0.009523809523809525}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009523809523809525, (0, 1): 0.9809523809523809, (0, 2): 0.009523809523809525}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 103.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=108.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9537037037037037, (1, 1): 0.009259259259259259, (1, 2): 0.037037037037037035}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9537037037037037, (1, 1): 0.009259259259259259, (1, 2): 0.037037037037037035}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 103.0 -> 104.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 103.0 -> 104.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 78.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=84.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9285714285714286, (1, 1): 0.023809523809523808, (1, 2): 0.047619047619047616}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9285714285714286, (1, 1): 0.023809523809523808, (1, 2): 0.047619047619047616}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 78.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=88.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.022727272727272728, (0, 1): 0.8863636363636364, (0, 2): 0.09090909090909091}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.022727272727272728, (0, 1): 0.8863636363636364, (0, 2): 0.09090909090909091}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 78.0 -> 79.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 78.0 -> 79.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 149.0}
in get_filtered_urn(filter=1) --- total: total=151.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.006622516556291391, (1, 1): 0.006622516556291391, (1, 2): 0.9867549668874173}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.006622516556291391, (1, 1): 0.006622516556291391, (1, 2): 0.9867549668874173}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 149.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=151.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.006622516556291391, (2, 1): 0.9867549668874173, (2, 2): 0.006622516556291391}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.006622516556291391, (2, 1): 0.9867549668874173, (2, 2): 0.006622516556291391}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 149.0 -> 150.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 149.0 -> 150.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 76.0}
in get_filtered_urn(filter=0) --- total: total=88.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.022727272727272728, (0, 1): 0.11363636363636363, (0, 2): 0.8636363636363636}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.022727272727272728, (0, 1): 0.11363636363636363, (0, 2): 0.8636363636363636}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 73.0}
in get_filtered_urn(filter=1) --- total: total=85.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.11764705882352941, (1, 1): 0.023529411764705882, (1, 2): 0.8588235294117647}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.11764705882352941, (1, 1): 0.023529411764705882, (1, 2): 0.8588235294117647}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 73.0 -> 73.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 92.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=97.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9484536082474226, (2, 1): 0.041237113402061855, (2, 2): 0.010309278350515464}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9484536082474226, (2, 1): 0.041237113402061855, (2, 2): 0.010309278350515464}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 92.0}
in get_filtered_urn(filter=0) --- total: total=94.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010638297872340425, (0, 1): 0.010638297872340425, (0, 2): 0.9787234042553191}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010638297872340425, (0, 1): 0.010638297872340425, (0, 2): 0.9787234042553191}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 92.0 -> 93.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 92.0 -> 93.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 79.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=85.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9294117647058824, (1, 1): 0.023529411764705882, (1, 2): 0.047058823529411764}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9294117647058824, (1, 1): 0.023529411764705882, (1, 2): 0.047058823529411764}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 79.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=89.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02247191011235955, (0, 1): 0.8876404494382022, (0, 2): 0.0898876404494382}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.02247191011235955, (0, 1): 0.8876404494382022, (0, 2): 0.0898876404494382}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 79.0 -> 80.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 79.0 -> 80.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 150.0}
in get_filtered_urn(filter=1) --- total: total=152.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.006578947368421052, (1, 1): 0.006578947368421052, (1, 2): 0.9868421052631579}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.006578947368421052, (1, 1): 0.006578947368421052, (1, 2): 0.9868421052631579}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 150.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=152.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.006578947368421052, (2, 1): 0.9868421052631579, (2, 2): 0.006578947368421052}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.006578947368421052, (2, 1): 0.9868421052631579, (2, 2): 0.006578947368421052}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 150.0 -> 151.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 150.0 -> 151.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 76.0}
in get_filtered_urn(filter=0) --- total: total=88.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.022727272727272728, (0, 1): 0.11363636363636363, (0, 2): 0.8636363636363636}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.022727272727272728, (0, 1): 0.11363636363636363, (0, 2): 0.8636363636363636}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 76.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=82.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.926829268292683, (2, 1): 0.04878048780487805, (2, 2): 0.024390243902439025}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.926829268292683, (2, 1): 0.04878048780487805, (2, 2): 0.024390243902439025}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 76.0 -> 77.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 76.0 -> 77.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 104.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=106.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009433962264150943, (0, 1): 0.9811320754716981, (0, 2): 0.009433962264150943}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009433962264150943, (0, 1): 0.9811320754716981, (0, 2): 0.009433962264150943}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 104.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=109.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9541284403669725, (1, 1): 0.009174311926605505, (1, 2): 0.03669724770642202}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9541284403669725, (1, 1): 0.009174311926605505, (1, 2): 0.03669724770642202}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 104.0 -> 105.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 104.0 -> 105.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 77.0}
in get_filtered_urn(filter=0) --- total: total=89.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02247191011235955, (0, 1): 0.11235955056179775, (0, 2): 0.8651685393258427}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02247191011235955, (0, 1): 0.11235955056179775, (0, 2): 0.8651685393258427}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 77.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=83.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.927710843373494, (2, 1): 0.04819277108433735, (2, 2): 0.024096385542168676}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.927710843373494, (2, 1): 0.04819277108433735, (2, 2): 0.024096385542168676}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 77.0 -> 78.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 77.0 -> 78.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 105.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=107.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009345794392523364, (0, 1): 0.9813084112149533, (0, 2): 0.009345794392523364}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009345794392523364, (0, 1): 0.9813084112149533, (0, 2): 0.009345794392523364}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 105.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=110.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9545454545454546, (1, 1): 0.00909090909090909, (1, 2): 0.03636363636363636}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9545454545454546, (1, 1): 0.00909090909090909, (1, 2): 0.03636363636363636}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 105.0 -> 106.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 105.0 -> 106.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 78.0}
in get_filtered_urn(filter=0) --- total: total=90.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.022222222222222223, (0, 1): 0.1111111111111111, (0, 2): 0.8666666666666667}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.022222222222222223, (0, 1): 0.1111111111111111, (0, 2): 0.8666666666666667}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 78.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=84.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9285714285714286, (2, 1): 0.047619047619047616, (2, 2): 0.023809523809523808}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9285714285714286, (2, 1): 0.047619047619047616, (2, 2): 0.023809523809523808}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 78.0 -> 79.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 78.0 -> 79.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 151.0}
in get_filtered_urn(filter=1) --- total: total=153.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.006535947712418301, (1, 1): 0.006535947712418301, (1, 2): 0.9869281045751634}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.006535947712418301, (1, 1): 0.006535947712418301, (1, 2): 0.9869281045751634}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 151.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=153.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.006535947712418301, (2, 1): 0.9869281045751634, (2, 2): 0.006535947712418301}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.006535947712418301, (2, 1): 0.9869281045751634, (2, 2): 0.006535947712418301}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 151.0 -> 152.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 151.0 -> 152.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 79.0}
in get_filtered_urn(filter=0) --- total: total=91.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02197802197802198, (0, 1): 0.10989010989010989, (0, 2): 0.8681318681318682}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02197802197802198, (0, 1): 0.10989010989010989, (0, 2): 0.8681318681318682}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 79.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=85.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9294117647058824, (2, 1): 0.047058823529411764, (2, 2): 0.023529411764705882}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9294117647058824, (2, 1): 0.047058823529411764, (2, 2): 0.023529411764705882}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 79.0 -> 80.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 79.0 -> 80.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 106.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=108.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009259259259259259, (0, 1): 0.9814814814814815, (0, 2): 0.009259259259259259}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009259259259259259, (0, 1): 0.9814814814814815, (0, 2): 0.009259259259259259}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 106.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=111.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.954954954954955, (1, 1): 0.009009009009009009, (1, 2): 0.036036036036036036}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.954954954954955, (1, 1): 0.009009009009009009, (1, 2): 0.036036036036036036}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 106.0 -> 107.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 106.0 -> 107.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 80.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=86.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9302325581395349, (1, 1): 0.023255813953488372, (1, 2): 0.046511627906976744}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.9302325581395349, (1, 1): 0.023255813953488372, (1, 2): 0.046511627906976744}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 80.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=86.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9302325581395349, (2, 1): 0.046511627906976744, (2, 2): 0.023255813953488372}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9302325581395349, (2, 1): 0.046511627906976744, (2, 2): 0.023255813953488372}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 80.0 -> 80.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 152.0}
in get_filtered_urn(filter=1) --- total: total=154.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.006493506493506494, (1, 1): 0.006493506493506494, (1, 2): 0.987012987012987}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.006493506493506494, (1, 1): 0.006493506493506494, (1, 2): 0.987012987012987}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 152.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=154.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.006493506493506494, (2, 1): 0.987012987012987, (2, 2): 0.006493506493506494}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.006493506493506494, (2, 1): 0.987012987012987, (2, 2): 0.006493506493506494}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 152.0 -> 153.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 152.0 -> 153.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 80.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=86.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9302325581395349, (1, 1): 0.023255813953488372, (1, 2): 0.046511627906976744}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9302325581395349, (1, 1): 0.023255813953488372, (1, 2): 0.046511627906976744}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 80.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=90.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.022222222222222223, (0, 1): 0.8888888888888888, (0, 2): 0.08888888888888889}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.022222222222222223, (0, 1): 0.8888888888888888, (0, 2): 0.08888888888888889}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 80.0 -> 81.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 80.0 -> 81.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 153.0}
in get_filtered_urn(filter=1) --- total: total=155.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0064516129032258064, (1, 1): 0.0064516129032258064, (1, 2): 0.9870967741935484}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0064516129032258064, (1, 1): 0.0064516129032258064, (1, 2): 0.9870967741935484}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 153.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=155.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0064516129032258064, (2, 1): 0.9870967741935484, (2, 2): 0.0064516129032258064}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0064516129032258064, (2, 1): 0.9870967741935484, (2, 2): 0.0064516129032258064}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 153.0 -> 154.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 153.0 -> 154.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 80.0}
in get_filtered_urn(filter=0) --- total: total=92.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.021739130434782608, (0, 1): 0.10869565217391304, (0, 2): 0.8695652173913043}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.021739130434782608, (0, 1): 0.10869565217391304, (0, 2): 0.8695652173913043}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 80.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=86.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9302325581395349, (2, 1): 0.046511627906976744, (2, 2): 0.023255813953488372}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.9302325581395349, (2, 1): 0.046511627906976744, (2, 2): 0.023255813953488372}
in decode_message(signal=2) Receiver 5 got option: (2, 1) and decoded action: 1
Receiver 5 received signals: [2] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 2): 80.0 -> 80.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 1): 4.0 -> 4.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 154.0}
in get_filtered_urn(filter=1) --- total: total=156.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.00641025641025641, (1, 1): 0.00641025641025641, (1, 2): 0.9871794871794872}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.00641025641025641, (1, 1): 0.00641025641025641, (1, 2): 0.9871794871794872}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 154.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=156.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.00641025641025641, (2, 1): 0.9871794871794872, (2, 2): 0.00641025641025641}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.00641025641025641, (2, 1): 0.9871794871794872, (2, 2): 0.00641025641025641}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 154.0 -> 155.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 154.0 -> 155.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 73.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=83.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0963855421686747, (2, 1): 0.8795180722891566, (2, 2): 0.024096385542168676}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.0963855421686747, (2, 1): 0.8795180722891566, (2, 2): 0.024096385542168676}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 81.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=91.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02197802197802198, (0, 1): 0.8901098901098901, (0, 2): 0.08791208791208792}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.02197802197802198, (0, 1): 0.8901098901098901, (0, 2): 0.08791208791208792}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 8.0 -> 8.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 81.0 -> 81.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 107.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=109.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009174311926605505, (0, 1): 0.981651376146789, (0, 2): 0.009174311926605505}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009174311926605505, (0, 1): 0.981651376146789, (0, 2): 0.009174311926605505}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 107.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=112.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9553571428571429, (1, 1): 0.008928571428571428, (1, 2): 0.03571428571428571}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9553571428571429, (1, 1): 0.008928571428571428, (1, 2): 0.03571428571428571}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 107.0 -> 108.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 107.0 -> 108.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 73.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=83.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0963855421686747, (2, 1): 0.8795180722891566, (2, 2): 0.024096385542168676}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.0963855421686747, (2, 1): 0.8795180722891566, (2, 2): 0.024096385542168676}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 81.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=91.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02197802197802198, (0, 1): 0.8901098901098901, (0, 2): 0.08791208791208792}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.02197802197802198, (0, 1): 0.8901098901098901, (0, 2): 0.08791208791208792}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 8.0 -> 8.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 81.0 -> 81.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 155.0}
in get_filtered_urn(filter=1) --- total: total=157.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.006369426751592357, (1, 1): 0.006369426751592357, (1, 2): 0.9872611464968153}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.006369426751592357, (1, 1): 0.006369426751592357, (1, 2): 0.9872611464968153}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 155.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=157.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.006369426751592357, (2, 1): 0.9872611464968153, (2, 2): 0.006369426751592357}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.006369426751592357, (2, 1): 0.9872611464968153, (2, 2): 0.006369426751592357}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 155.0 -> 156.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 155.0 -> 156.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 81.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=87.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9310344827586207, (1, 1): 0.022988505747126436, (1, 2): 0.04597701149425287}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9310344827586207, (1, 1): 0.022988505747126436, (1, 2): 0.04597701149425287}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 81.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=91.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02197802197802198, (0, 1): 0.8901098901098901, (0, 2): 0.08791208791208792}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.02197802197802198, (0, 1): 0.8901098901098901, (0, 2): 0.08791208791208792}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 81.0 -> 82.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 81.0 -> 82.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 156.0}
in get_filtered_urn(filter=1) --- total: total=158.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.006329113924050633, (1, 1): 0.006329113924050633, (1, 2): 0.9873417721518988}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.006329113924050633, (1, 1): 0.006329113924050633, (1, 2): 0.9873417721518988}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 156.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=158.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.006329113924050633, (2, 1): 0.9873417721518988, (2, 2): 0.006329113924050633}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.006329113924050633, (2, 1): 0.9873417721518988, (2, 2): 0.006329113924050633}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 156.0 -> 157.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 156.0 -> 157.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 80.0}
in get_filtered_urn(filter=0) --- total: total=92.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.021739130434782608, (0, 1): 0.10869565217391304, (0, 2): 0.8695652173913043}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.021739130434782608, (0, 1): 0.10869565217391304, (0, 2): 0.8695652173913043}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 73.0}
in get_filtered_urn(filter=1) --- total: total=85.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.11764705882352941, (1, 1): 0.023529411764705882, (1, 2): 0.8588235294117647}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.11764705882352941, (1, 1): 0.023529411764705882, (1, 2): 0.8588235294117647}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 73.0 -> 73.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 157.0}
in get_filtered_urn(filter=1) --- total: total=159.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.006289308176100629, (1, 1): 0.006289308176100629, (1, 2): 0.9874213836477987}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.006289308176100629, (1, 1): 0.006289308176100629, (1, 2): 0.9874213836477987}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 157.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=159.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.006289308176100629, (2, 1): 0.9874213836477987, (2, 2): 0.006289308176100629}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.006289308176100629, (2, 1): 0.9874213836477987, (2, 2): 0.006289308176100629}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 157.0 -> 158.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 157.0 -> 158.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 82.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=88.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9318181818181818, (1, 1): 0.022727272727272728, (1, 2): 0.045454545454545456}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9318181818181818, (1, 1): 0.022727272727272728, (1, 2): 0.045454545454545456}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 82.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=92.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.021739130434782608, (0, 1): 0.8913043478260869, (0, 2): 0.08695652173913043}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.021739130434782608, (0, 1): 0.8913043478260869, (0, 2): 0.08695652173913043}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 82.0 -> 83.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 82.0 -> 83.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 93.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=98.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9489795918367347, (2, 1): 0.04081632653061224, (2, 2): 0.01020408163265306}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9489795918367347, (2, 1): 0.04081632653061224, (2, 2): 0.01020408163265306}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 93.0}
in get_filtered_urn(filter=0) --- total: total=95.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010526315789473684, (0, 1): 0.010526315789473684, (0, 2): 0.9789473684210527}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010526315789473684, (0, 1): 0.010526315789473684, (0, 2): 0.9789473684210527}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 93.0 -> 94.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 93.0 -> 94.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 80.0}
in get_filtered_urn(filter=0) --- total: total=92.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.021739130434782608, (0, 1): 0.10869565217391304, (0, 2): 0.8695652173913043}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.021739130434782608, (0, 1): 0.10869565217391304, (0, 2): 0.8695652173913043}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 80.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=86.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9302325581395349, (2, 1): 0.046511627906976744, (2, 2): 0.023255813953488372}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.9302325581395349, (2, 1): 0.046511627906976744, (2, 2): 0.023255813953488372}
in decode_message(signal=2) Receiver 5 got option: (2, 2) and decoded action: 2
Receiver 5 received signals: [2] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 2): 80.0 -> 80.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 158.0}
in get_filtered_urn(filter=1) --- total: total=160.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.00625, (1, 1): 0.00625, (1, 2): 0.9875}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.00625, (1, 1): 0.00625, (1, 2): 0.9875}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 158.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=160.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.00625, (2, 1): 0.9875, (2, 2): 0.00625}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.00625, (2, 1): 0.9875, (2, 2): 0.00625}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 158.0 -> 159.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 158.0 -> 159.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 80.0}
in get_filtered_urn(filter=0) --- total: total=92.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.021739130434782608, (0, 1): 0.10869565217391304, (0, 2): 0.8695652173913043}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.021739130434782608, (0, 1): 0.10869565217391304, (0, 2): 0.8695652173913043}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 80.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=86.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9302325581395349, (2, 1): 0.046511627906976744, (2, 2): 0.023255813953488372}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9302325581395349, (2, 1): 0.046511627906976744, (2, 2): 0.023255813953488372}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 80.0 -> 81.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 80.0 -> 81.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 159.0}
in get_filtered_urn(filter=1) --- total: total=161.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.006211180124223602, (1, 1): 0.006211180124223602, (1, 2): 0.9875776397515528}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.006211180124223602, (1, 1): 0.006211180124223602, (1, 2): 0.9875776397515528}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 159.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=161.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.006211180124223602, (2, 1): 0.9875776397515528, (2, 2): 0.006211180124223602}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.006211180124223602, (2, 1): 0.9875776397515528, (2, 2): 0.006211180124223602}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 159.0 -> 160.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 159.0 -> 160.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 83.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=89.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9325842696629213, (1, 1): 0.02247191011235955, (1, 2): 0.0449438202247191}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.9325842696629213, (1, 1): 0.02247191011235955, (1, 2): 0.0449438202247191}
Sender 4 got filter 1 choose option: (1, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 73.0}
in get_filtered_urn(filter=1) --- total: total=85.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.11764705882352941, (1, 1): 0.023529411764705882, (1, 2): 0.8588235294117647}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.11764705882352941, (1, 1): 0.023529411764705882, (1, 2): 0.8588235294117647}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 1): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 73.0 -> 73.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 94.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=99.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9494949494949495, (2, 1): 0.04040404040404041, (2, 2): 0.010101010101010102}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9494949494949495, (2, 1): 0.04040404040404041, (2, 2): 0.010101010101010102}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 94.0}
in get_filtered_urn(filter=0) --- total: total=96.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010416666666666666, (0, 1): 0.010416666666666666, (0, 2): 0.9791666666666666}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010416666666666666, (0, 1): 0.010416666666666666, (0, 2): 0.9791666666666666}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 94.0 -> 95.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 94.0 -> 95.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 81.0}
in get_filtered_urn(filter=0) --- total: total=93.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.021505376344086023, (0, 1): 0.10752688172043011, (0, 2): 0.8709677419354839}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.021505376344086023, (0, 1): 0.10752688172043011, (0, 2): 0.8709677419354839}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 81.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=87.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9310344827586207, (2, 1): 0.04597701149425287, (2, 2): 0.022988505747126436}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9310344827586207, (2, 1): 0.04597701149425287, (2, 2): 0.022988505747126436}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 81.0 -> 82.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 81.0 -> 82.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 95.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=100.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.95, (2, 1): 0.04, (2, 2): 0.01}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.95, (2, 1): 0.04, (2, 2): 0.01}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 108.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=113.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9557522123893806, (1, 1): 0.008849557522123894, (1, 2): 0.035398230088495575}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9557522123893806, (1, 1): 0.008849557522123894, (1, 2): 0.035398230088495575}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 1): 4.0 -> 4.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 0): 108.0 -> 108.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 83.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=89.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9325842696629213, (1, 1): 0.02247191011235955, (1, 2): 0.0449438202247191}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9325842696629213, (1, 1): 0.02247191011235955, (1, 2): 0.0449438202247191}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 83.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=93.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.021505376344086023, (0, 1): 0.8924731182795699, (0, 2): 0.08602150537634409}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.021505376344086023, (0, 1): 0.8924731182795699, (0, 2): 0.08602150537634409}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 83.0 -> 83.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 8.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 160.0}
in get_filtered_urn(filter=1) --- total: total=162.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.006172839506172839, (1, 1): 0.006172839506172839, (1, 2): 0.9876543209876543}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.006172839506172839, (1, 1): 0.006172839506172839, (1, 2): 0.9876543209876543}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 160.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=162.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.006172839506172839, (2, 1): 0.9876543209876543, (2, 2): 0.006172839506172839}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.006172839506172839, (2, 1): 0.9876543209876543, (2, 2): 0.006172839506172839}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 160.0 -> 161.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 160.0 -> 161.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 83.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=89.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9325842696629213, (1, 1): 0.02247191011235955, (1, 2): 0.0449438202247191}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9325842696629213, (1, 1): 0.02247191011235955, (1, 2): 0.0449438202247191}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 83.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=93.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.021505376344086023, (0, 1): 0.8924731182795699, (0, 2): 0.08602150537634409}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.021505376344086023, (0, 1): 0.8924731182795699, (0, 2): 0.08602150537634409}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 83.0 -> 84.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 83.0 -> 84.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 108.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=110.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00909090909090909, (0, 1): 0.9818181818181818, (0, 2): 0.00909090909090909}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00909090909090909, (0, 1): 0.9818181818181818, (0, 2): 0.00909090909090909}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 108.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=113.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9557522123893806, (1, 1): 0.008849557522123894, (1, 2): 0.035398230088495575}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9557522123893806, (1, 1): 0.008849557522123894, (1, 2): 0.035398230088495575}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 108.0 -> 109.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 108.0 -> 109.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 84.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=90.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9333333333333333, (1, 1): 0.022222222222222223, (1, 2): 0.044444444444444446}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9333333333333333, (1, 1): 0.022222222222222223, (1, 2): 0.044444444444444446}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 84.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=94.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02127659574468085, (0, 1): 0.8936170212765957, (0, 2): 0.0851063829787234}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.02127659574468085, (0, 1): 0.8936170212765957, (0, 2): 0.0851063829787234}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 84.0 -> 85.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 84.0 -> 85.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 161.0}
in get_filtered_urn(filter=1) --- total: total=163.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.006134969325153374, (1, 1): 0.006134969325153374, (1, 2): 0.9877300613496932}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.006134969325153374, (1, 1): 0.006134969325153374, (1, 2): 0.9877300613496932}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 161.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=163.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.006134969325153374, (2, 1): 0.9877300613496932, (2, 2): 0.006134969325153374}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.006134969325153374, (2, 1): 0.9877300613496932, (2, 2): 0.006134969325153374}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 161.0 -> 162.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 161.0 -> 162.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 73.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=83.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0963855421686747, (2, 1): 0.8795180722891566, (2, 2): 0.024096385542168676}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.0963855421686747, (2, 1): 0.8795180722891566, (2, 2): 0.024096385542168676}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 82.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=88.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9318181818181818, (2, 1): 0.045454545454545456, (2, 2): 0.022727272727272728}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9318181818181818, (2, 1): 0.045454545454545456, (2, 2): 0.022727272727272728}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 82.0 -> 82.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 95.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=100.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.95, (2, 1): 0.04, (2, 2): 0.01}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.95, (2, 1): 0.04, (2, 2): 0.01}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 95.0}
in get_filtered_urn(filter=0) --- total: total=97.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010309278350515464, (0, 1): 0.010309278350515464, (0, 2): 0.979381443298969}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010309278350515464, (0, 1): 0.010309278350515464, (0, 2): 0.979381443298969}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 95.0 -> 96.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 95.0 -> 96.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 73.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=83.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0963855421686747, (2, 1): 0.8795180722891566, (2, 2): 0.024096385542168676}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0963855421686747, (2, 1): 0.8795180722891566, (2, 2): 0.024096385542168676}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 73.0}
in get_filtered_urn(filter=1) --- total: total=85.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.11764705882352941, (1, 1): 0.023529411764705882, (1, 2): 0.8588235294117647}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.11764705882352941, (1, 1): 0.023529411764705882, (1, 2): 0.8588235294117647}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 73.0 -> 74.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 73.0 -> 74.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 109.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=111.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009009009009009009, (0, 1): 0.9819819819819819, (0, 2): 0.009009009009009009}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009009009009009009, (0, 1): 0.9819819819819819, (0, 2): 0.009009009009009009}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 109.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=114.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.956140350877193, (1, 1): 0.008771929824561403, (1, 2): 0.03508771929824561}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.956140350877193, (1, 1): 0.008771929824561403, (1, 2): 0.03508771929824561}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 109.0 -> 110.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 109.0 -> 110.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 85.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=91.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9340659340659341, (1, 1): 0.02197802197802198, (1, 2): 0.04395604395604396}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9340659340659341, (1, 1): 0.02197802197802198, (1, 2): 0.04395604395604396}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 85.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=95.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.021052631578947368, (0, 1): 0.8947368421052632, (0, 2): 0.08421052631578947}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.021052631578947368, (0, 1): 0.8947368421052632, (0, 2): 0.08421052631578947}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 85.0 -> 85.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 8.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 96.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=101.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9504950495049505, (2, 1): 0.039603960396039604, (2, 2): 0.009900990099009901}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9504950495049505, (2, 1): 0.039603960396039604, (2, 2): 0.009900990099009901}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 96.0}
in get_filtered_urn(filter=0) --- total: total=98.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01020408163265306, (0, 1): 0.01020408163265306, (0, 2): 0.9795918367346939}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.01020408163265306, (0, 1): 0.01020408163265306, (0, 2): 0.9795918367346939}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 96.0 -> 97.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 96.0 -> 97.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 85.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=91.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9340659340659341, (1, 1): 0.02197802197802198, (1, 2): 0.04395604395604396}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9340659340659341, (1, 1): 0.02197802197802198, (1, 2): 0.04395604395604396}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 85.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=95.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.021052631578947368, (0, 1): 0.8947368421052632, (0, 2): 0.08421052631578947}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.021052631578947368, (0, 1): 0.8947368421052632, (0, 2): 0.08421052631578947}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 85.0 -> 86.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 85.0 -> 86.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 110.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=112.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008928571428571428, (0, 1): 0.9821428571428571, (0, 2): 0.008928571428571428}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008928571428571428, (0, 1): 0.9821428571428571, (0, 2): 0.008928571428571428}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 110.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=115.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9565217391304348, (1, 1): 0.008695652173913044, (1, 2): 0.034782608695652174}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9565217391304348, (1, 1): 0.008695652173913044, (1, 2): 0.034782608695652174}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 110.0 -> 111.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 110.0 -> 111.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 82.0}
in get_filtered_urn(filter=0) --- total: total=94.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02127659574468085, (0, 1): 0.10638297872340426, (0, 2): 0.8723404255319149}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.02127659574468085, (0, 1): 0.10638297872340426, (0, 2): 0.8723404255319149}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 74.0}
in get_filtered_urn(filter=1) --- total: total=86.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.11627906976744186, (1, 1): 0.023255813953488372, (1, 2): 0.8604651162790697}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.11627906976744186, (1, 1): 0.023255813953488372, (1, 2): 0.8604651162790697}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 74.0 -> 74.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 111.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=113.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008849557522123894, (0, 1): 0.9823008849557522, (0, 2): 0.008849557522123894}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008849557522123894, (0, 1): 0.9823008849557522, (0, 2): 0.008849557522123894}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 111.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=116.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9568965517241379, (1, 1): 0.008620689655172414, (1, 2): 0.034482758620689655}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9568965517241379, (1, 1): 0.008620689655172414, (1, 2): 0.034482758620689655}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 111.0 -> 112.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 111.0 -> 112.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 86.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=92.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9347826086956522, (1, 1): 0.021739130434782608, (1, 2): 0.043478260869565216}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.9347826086956522, (1, 1): 0.021739130434782608, (1, 2): 0.043478260869565216}
Sender 4 got filter 1 choose option: (1, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 74.0}
in get_filtered_urn(filter=1) --- total: total=86.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.11627906976744186, (1, 1): 0.023255813953488372, (1, 2): 0.8604651162790697}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.11627906976744186, (1, 1): 0.023255813953488372, (1, 2): 0.8604651162790697}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 1): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 74.0 -> 74.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 112.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=114.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008771929824561403, (0, 1): 0.9824561403508771, (0, 2): 0.008771929824561403}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008771929824561403, (0, 1): 0.9824561403508771, (0, 2): 0.008771929824561403}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 112.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=117.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9572649572649573, (1, 1): 0.008547008547008548, (1, 2): 0.03418803418803419}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9572649572649573, (1, 1): 0.008547008547008548, (1, 2): 0.03418803418803419}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 112.0 -> 113.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 112.0 -> 113.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 82.0}
in get_filtered_urn(filter=0) --- total: total=94.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02127659574468085, (0, 1): 0.10638297872340426, (0, 2): 0.8723404255319149}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02127659574468085, (0, 1): 0.10638297872340426, (0, 2): 0.8723404255319149}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 82.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=88.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9318181818181818, (2, 1): 0.045454545454545456, (2, 2): 0.022727272727272728}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9318181818181818, (2, 1): 0.045454545454545456, (2, 2): 0.022727272727272728}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 82.0 -> 83.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 82.0 -> 83.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 113.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=115.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008695652173913044, (0, 1): 0.9826086956521739, (0, 2): 0.008695652173913044}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008695652173913044, (0, 1): 0.9826086956521739, (0, 2): 0.008695652173913044}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 113.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=118.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9576271186440678, (1, 1): 0.00847457627118644, (1, 2): 0.03389830508474576}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9576271186440678, (1, 1): 0.00847457627118644, (1, 2): 0.03389830508474576}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 113.0 -> 114.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 113.0 -> 114.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 83.0}
in get_filtered_urn(filter=0) --- total: total=95.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.021052631578947368, (0, 1): 0.10526315789473684, (0, 2): 0.8736842105263158}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.021052631578947368, (0, 1): 0.10526315789473684, (0, 2): 0.8736842105263158}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 83.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=89.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9325842696629213, (2, 1): 0.0449438202247191, (2, 2): 0.02247191011235955}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9325842696629213, (2, 1): 0.0449438202247191, (2, 2): 0.02247191011235955}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 83.0 -> 84.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 83.0 -> 84.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 162.0}
in get_filtered_urn(filter=1) --- total: total=164.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.006097560975609756, (1, 1): 0.006097560975609756, (1, 2): 0.9878048780487805}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.006097560975609756, (1, 1): 0.006097560975609756, (1, 2): 0.9878048780487805}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 162.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=164.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.006097560975609756, (2, 1): 0.9878048780487805, (2, 2): 0.006097560975609756}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.006097560975609756, (2, 1): 0.9878048780487805, (2, 2): 0.006097560975609756}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 162.0 -> 163.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 162.0 -> 163.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 84.0}
in get_filtered_urn(filter=0) --- total: total=96.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.020833333333333332, (0, 1): 0.10416666666666667, (0, 2): 0.875}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.020833333333333332, (0, 1): 0.10416666666666667, (0, 2): 0.875}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 84.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=90.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9333333333333333, (2, 1): 0.044444444444444446, (2, 2): 0.022222222222222223}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9333333333333333, (2, 1): 0.044444444444444446, (2, 2): 0.022222222222222223}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 84.0 -> 85.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 84.0 -> 85.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 97.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=102.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9509803921568627, (2, 1): 0.0392156862745098, (2, 2): 0.00980392156862745}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9509803921568627, (2, 1): 0.0392156862745098, (2, 2): 0.00980392156862745}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 97.0}
in get_filtered_urn(filter=0) --- total: total=99.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010101010101010102, (0, 1): 0.010101010101010102, (0, 2): 0.9797979797979798}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010101010101010102, (0, 1): 0.010101010101010102, (0, 2): 0.9797979797979798}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 97.0 -> 98.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 97.0 -> 98.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 85.0}
in get_filtered_urn(filter=0) --- total: total=97.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.020618556701030927, (0, 1): 0.10309278350515463, (0, 2): 0.8762886597938144}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.020618556701030927, (0, 1): 0.10309278350515463, (0, 2): 0.8762886597938144}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 85.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=91.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9340659340659341, (2, 1): 0.04395604395604396, (2, 2): 0.02197802197802198}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9340659340659341, (2, 1): 0.04395604395604396, (2, 2): 0.02197802197802198}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 85.0 -> 86.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 85.0 -> 86.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 98.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=103.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9514563106796117, (2, 1): 0.038834951456310676, (2, 2): 0.009708737864077669}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9514563106796117, (2, 1): 0.038834951456310676, (2, 2): 0.009708737864077669}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 98.0}
in get_filtered_urn(filter=0) --- total: total=100.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01, (0, 1): 0.01, (0, 2): 0.98}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.01, (0, 1): 0.01, (0, 2): 0.98}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 98.0 -> 99.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 98.0 -> 99.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 74.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=84.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09523809523809523, (2, 1): 0.8809523809523809, (2, 2): 0.023809523809523808}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.09523809523809523, (2, 1): 0.8809523809523809, (2, 2): 0.023809523809523808}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 74.0}
in get_filtered_urn(filter=1) --- total: total=86.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.11627906976744186, (1, 1): 0.023255813953488372, (1, 2): 0.8604651162790697}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.11627906976744186, (1, 1): 0.023255813953488372, (1, 2): 0.8604651162790697}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 74.0 -> 75.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 74.0 -> 75.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 114.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=116.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008620689655172414, (0, 1): 0.9827586206896551, (0, 2): 0.008620689655172414}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008620689655172414, (0, 1): 0.9827586206896551, (0, 2): 0.008620689655172414}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 114.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=119.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.957983193277311, (1, 1): 0.008403361344537815, (1, 2): 0.03361344537815126}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.957983193277311, (1, 1): 0.008403361344537815, (1, 2): 0.03361344537815126}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 114.0 -> 115.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 114.0 -> 115.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 86.0}
in get_filtered_urn(filter=0) --- total: total=98.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02040816326530612, (0, 1): 0.10204081632653061, (0, 2): 0.8775510204081632}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02040816326530612, (0, 1): 0.10204081632653061, (0, 2): 0.8775510204081632}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 86.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=92.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9347826086956522, (2, 1): 0.043478260869565216, (2, 2): 0.021739130434782608}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9347826086956522, (2, 1): 0.043478260869565216, (2, 2): 0.021739130434782608}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 86.0 -> 87.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 86.0 -> 87.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 163.0}
in get_filtered_urn(filter=1) --- total: total=165.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.006060606060606061, (1, 1): 0.006060606060606061, (1, 2): 0.9878787878787879}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.006060606060606061, (1, 1): 0.006060606060606061, (1, 2): 0.9878787878787879}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 163.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=165.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.006060606060606061, (2, 1): 0.9878787878787879, (2, 2): 0.006060606060606061}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.006060606060606061, (2, 1): 0.9878787878787879, (2, 2): 0.006060606060606061}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 163.0 -> 164.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 163.0 -> 164.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 75.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=85.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09411764705882353, (2, 1): 0.8823529411764706, (2, 2): 0.023529411764705882}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.09411764705882353, (2, 1): 0.8823529411764706, (2, 2): 0.023529411764705882}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 87.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=93.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9354838709677419, (2, 1): 0.043010752688172046, (2, 2): 0.021505376344086023}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9354838709677419, (2, 1): 0.043010752688172046, (2, 2): 0.021505376344086023}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 87.0 -> 87.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 164.0}
in get_filtered_urn(filter=1) --- total: total=166.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.006024096385542169, (1, 1): 0.006024096385542169, (1, 2): 0.9879518072289156}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.006024096385542169, (1, 1): 0.006024096385542169, (1, 2): 0.9879518072289156}
Sender 1 got filter 1 choose option: (1, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 99.0}
in get_filtered_urn(filter=0) --- total: total=101.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009900990099009901, (0, 1): 0.009900990099009901, (0, 2): 0.9801980198019802}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009900990099009901, (0, 1): 0.009900990099009901, (0, 2): 0.9801980198019802}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (1, 0): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 2): 99.0 -> 99.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 75.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=85.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09411764705882353, (2, 1): 0.8823529411764706, (2, 2): 0.023529411764705882}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.09411764705882353, (2, 1): 0.8823529411764706, (2, 2): 0.023529411764705882}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 75.0}
in get_filtered_urn(filter=1) --- total: total=87.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.11494252873563218, (1, 1): 0.022988505747126436, (1, 2): 0.8620689655172413}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.11494252873563218, (1, 1): 0.022988505747126436, (1, 2): 0.8620689655172413}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 75.0 -> 76.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 75.0 -> 76.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 164.0}
in get_filtered_urn(filter=1) --- total: total=166.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.006024096385542169, (1, 1): 0.006024096385542169, (1, 2): 0.9879518072289156}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.006024096385542169, (1, 1): 0.006024096385542169, (1, 2): 0.9879518072289156}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 164.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=166.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.006024096385542169, (2, 1): 0.9879518072289156, (2, 2): 0.006024096385542169}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.006024096385542169, (2, 1): 0.9879518072289156, (2, 2): 0.006024096385542169}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 164.0 -> 165.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 164.0 -> 165.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 87.0}
in get_filtered_urn(filter=0) --- total: total=99.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.020202020202020204, (0, 1): 0.10101010101010101, (0, 2): 0.8787878787878788}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.020202020202020204, (0, 1): 0.10101010101010101, (0, 2): 0.8787878787878788}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 87.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=93.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9354838709677419, (2, 1): 0.043010752688172046, (2, 2): 0.021505376344086023}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9354838709677419, (2, 1): 0.043010752688172046, (2, 2): 0.021505376344086023}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 87.0 -> 88.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 87.0 -> 88.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 165.0}
in get_filtered_urn(filter=1) --- total: total=167.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005988023952095809, (1, 1): 0.005988023952095809, (1, 2): 0.9880239520958084}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005988023952095809, (1, 1): 0.005988023952095809, (1, 2): 0.9880239520958084}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 165.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=167.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005988023952095809, (2, 1): 0.9880239520958084, (2, 2): 0.005988023952095809}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005988023952095809, (2, 1): 0.9880239520958084, (2, 2): 0.005988023952095809}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 165.0 -> 166.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 165.0 -> 166.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 76.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=86.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09302325581395349, (2, 1): 0.8837209302325582, (2, 2): 0.023255813953488372}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.09302325581395349, (2, 1): 0.8837209302325582, (2, 2): 0.023255813953488372}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 76.0}
in get_filtered_urn(filter=1) --- total: total=88.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.11363636363636363, (1, 1): 0.022727272727272728, (1, 2): 0.8636363636363636}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.11363636363636363, (1, 1): 0.022727272727272728, (1, 2): 0.8636363636363636}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 76.0 -> 77.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 76.0 -> 77.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 166.0}
in get_filtered_urn(filter=1) --- total: total=168.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005952380952380952, (1, 1): 0.005952380952380952, (1, 2): 0.9880952380952381}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005952380952380952, (1, 1): 0.005952380952380952, (1, 2): 0.9880952380952381}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 166.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=168.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005952380952380952, (2, 1): 0.9880952380952381, (2, 2): 0.005952380952380952}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005952380952380952, (2, 1): 0.9880952380952381, (2, 2): 0.005952380952380952}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 166.0 -> 167.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 166.0 -> 167.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 88.0}
in get_filtered_urn(filter=0) --- total: total=100.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02, (0, 1): 0.1, (0, 2): 0.88}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02, (0, 1): 0.1, (0, 2): 0.88}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 88.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=94.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9361702127659575, (2, 1): 0.0425531914893617, (2, 2): 0.02127659574468085}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9361702127659575, (2, 1): 0.0425531914893617, (2, 2): 0.02127659574468085}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 88.0 -> 89.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 88.0 -> 89.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 99.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=104.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9519230769230769, (2, 1): 0.038461538461538464, (2, 2): 0.009615384615384616}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9519230769230769, (2, 1): 0.038461538461538464, (2, 2): 0.009615384615384616}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 99.0}
in get_filtered_urn(filter=0) --- total: total=101.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009900990099009901, (0, 1): 0.009900990099009901, (0, 2): 0.9801980198019802}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009900990099009901, (0, 1): 0.009900990099009901, (0, 2): 0.9801980198019802}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 99.0 -> 100.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 99.0 -> 100.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 77.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=87.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09195402298850575, (2, 1): 0.8850574712643678, (2, 2): 0.022988505747126436}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.09195402298850575, (2, 1): 0.8850574712643678, (2, 2): 0.022988505747126436}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 77.0}
in get_filtered_urn(filter=1) --- total: total=89.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.11235955056179775, (1, 1): 0.02247191011235955, (1, 2): 0.8651685393258427}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.11235955056179775, (1, 1): 0.02247191011235955, (1, 2): 0.8651685393258427}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 77.0 -> 77.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 115.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=117.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008547008547008548, (0, 1): 0.9829059829059829, (0, 2): 0.008547008547008548}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008547008547008548, (0, 1): 0.9829059829059829, (0, 2): 0.008547008547008548}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 115.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=120.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9583333333333334, (1, 1): 0.008333333333333333, (1, 2): 0.03333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9583333333333334, (1, 1): 0.008333333333333333, (1, 2): 0.03333333333333333}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 115.0 -> 116.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 115.0 -> 116.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 89.0}
in get_filtered_urn(filter=0) --- total: total=101.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.019801980198019802, (0, 1): 0.09900990099009901, (0, 2): 0.8811881188118812}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.019801980198019802, (0, 1): 0.09900990099009901, (0, 2): 0.8811881188118812}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 89.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=95.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9368421052631579, (2, 1): 0.042105263157894736, (2, 2): 0.021052631578947368}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9368421052631579, (2, 1): 0.042105263157894736, (2, 2): 0.021052631578947368}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 89.0 -> 90.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 89.0 -> 90.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 116.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=118.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00847457627118644, (0, 1): 0.9830508474576272, (0, 2): 0.00847457627118644}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00847457627118644, (0, 1): 0.9830508474576272, (0, 2): 0.00847457627118644}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 116.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=121.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9586776859504132, (1, 1): 0.008264462809917356, (1, 2): 0.03305785123966942}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9586776859504132, (1, 1): 0.008264462809917356, (1, 2): 0.03305785123966942}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 116.0 -> 117.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 116.0 -> 117.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 86.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=92.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9347826086956522, (1, 1): 0.021739130434782608, (1, 2): 0.043478260869565216}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9347826086956522, (1, 1): 0.021739130434782608, (1, 2): 0.043478260869565216}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 86.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=96.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.020833333333333332, (0, 1): 0.8958333333333334, (0, 2): 0.08333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.020833333333333332, (0, 1): 0.8958333333333334, (0, 2): 0.08333333333333333}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 86.0 -> 87.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 86.0 -> 87.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 100.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=105.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9523809523809523, (2, 1): 0.0380952380952381, (2, 2): 0.009523809523809525}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9523809523809523, (2, 1): 0.0380952380952381, (2, 2): 0.009523809523809525}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 100.0}
in get_filtered_urn(filter=0) --- total: total=102.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00980392156862745, (0, 1): 0.00980392156862745, (0, 2): 0.9803921568627451}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00980392156862745, (0, 1): 0.00980392156862745, (0, 2): 0.9803921568627451}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 100.0 -> 101.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 100.0 -> 101.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 90.0}
in get_filtered_urn(filter=0) --- total: total=102.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0196078431372549, (0, 1): 0.09803921568627451, (0, 2): 0.8823529411764706}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0196078431372549, (0, 1): 0.09803921568627451, (0, 2): 0.8823529411764706}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 90.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=96.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9375, (2, 1): 0.041666666666666664, (2, 2): 0.020833333333333332}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9375, (2, 1): 0.041666666666666664, (2, 2): 0.020833333333333332}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 90.0 -> 91.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 90.0 -> 91.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 117.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=119.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008403361344537815, (0, 1): 0.9831932773109243, (0, 2): 0.008403361344537815}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008403361344537815, (0, 1): 0.9831932773109243, (0, 2): 0.008403361344537815}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 117.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=122.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9590163934426229, (1, 1): 0.00819672131147541, (1, 2): 0.03278688524590164}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9590163934426229, (1, 1): 0.00819672131147541, (1, 2): 0.03278688524590164}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 117.0 -> 118.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 117.0 -> 118.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 91.0}
in get_filtered_urn(filter=0) --- total: total=103.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.019417475728155338, (0, 1): 0.0970873786407767, (0, 2): 0.883495145631068}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.019417475728155338, (0, 1): 0.0970873786407767, (0, 2): 0.883495145631068}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 91.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=97.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9381443298969072, (2, 1): 0.041237113402061855, (2, 2): 0.020618556701030927}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9381443298969072, (2, 1): 0.041237113402061855, (2, 2): 0.020618556701030927}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 91.0 -> 92.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 91.0 -> 92.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 167.0}
in get_filtered_urn(filter=1) --- total: total=169.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005917159763313609, (1, 1): 0.005917159763313609, (1, 2): 0.9881656804733728}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005917159763313609, (1, 1): 0.005917159763313609, (1, 2): 0.9881656804733728}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 167.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=169.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005917159763313609, (2, 1): 0.9881656804733728, (2, 2): 0.005917159763313609}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005917159763313609, (2, 1): 0.9881656804733728, (2, 2): 0.005917159763313609}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 167.0 -> 168.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 167.0 -> 168.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 87.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=93.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9354838709677419, (1, 1): 0.021505376344086023, (1, 2): 0.043010752688172046}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9354838709677419, (1, 1): 0.021505376344086023, (1, 2): 0.043010752688172046}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 87.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=97.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.020618556701030927, (0, 1): 0.8969072164948454, (0, 2): 0.08247422680412371}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.020618556701030927, (0, 1): 0.8969072164948454, (0, 2): 0.08247422680412371}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 87.0 -> 88.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 87.0 -> 88.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 101.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=106.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9528301886792453, (2, 1): 0.03773584905660377, (2, 2): 0.009433962264150943}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9528301886792453, (2, 1): 0.03773584905660377, (2, 2): 0.009433962264150943}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 101.0}
in get_filtered_urn(filter=0) --- total: total=103.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009708737864077669, (0, 1): 0.009708737864077669, (0, 2): 0.9805825242718447}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009708737864077669, (0, 1): 0.009708737864077669, (0, 2): 0.9805825242718447}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 101.0 -> 102.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 101.0 -> 102.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 92.0}
in get_filtered_urn(filter=0) --- total: total=104.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.019230769230769232, (0, 1): 0.09615384615384616, (0, 2): 0.8846153846153846}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.019230769230769232, (0, 1): 0.09615384615384616, (0, 2): 0.8846153846153846}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 92.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=98.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9387755102040817, (2, 1): 0.04081632653061224, (2, 2): 0.02040816326530612}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9387755102040817, (2, 1): 0.04081632653061224, (2, 2): 0.02040816326530612}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 92.0 -> 93.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 92.0 -> 93.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 102.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=107.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9532710280373832, (2, 1): 0.037383177570093455, (2, 2): 0.009345794392523364}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9532710280373832, (2, 1): 0.037383177570093455, (2, 2): 0.009345794392523364}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 102.0}
in get_filtered_urn(filter=0) --- total: total=104.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009615384615384616, (0, 1): 0.009615384615384616, (0, 2): 0.9807692307692307}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009615384615384616, (0, 1): 0.009615384615384616, (0, 2): 0.9807692307692307}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 102.0 -> 103.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 102.0 -> 103.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 88.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=94.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9361702127659575, (1, 1): 0.02127659574468085, (1, 2): 0.0425531914893617}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9361702127659575, (1, 1): 0.02127659574468085, (1, 2): 0.0425531914893617}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 88.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=98.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02040816326530612, (0, 1): 0.8979591836734694, (0, 2): 0.08163265306122448}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.02040816326530612, (0, 1): 0.8979591836734694, (0, 2): 0.08163265306122448}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 88.0 -> 88.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 8.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 103.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=108.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9537037037037037, (2, 1): 0.037037037037037035, (2, 2): 0.009259259259259259}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9537037037037037, (2, 1): 0.037037037037037035, (2, 2): 0.009259259259259259}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 103.0}
in get_filtered_urn(filter=0) --- total: total=105.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009523809523809525, (0, 1): 0.009523809523809525, (0, 2): 0.9809523809523809}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009523809523809525, (0, 1): 0.009523809523809525, (0, 2): 0.9809523809523809}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 103.0 -> 104.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 103.0 -> 104.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 88.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=94.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9361702127659575, (1, 1): 0.02127659574468085, (1, 2): 0.0425531914893617}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9361702127659575, (1, 1): 0.02127659574468085, (1, 2): 0.0425531914893617}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 88.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=98.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02040816326530612, (0, 1): 0.8979591836734694, (0, 2): 0.08163265306122448}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.02040816326530612, (0, 1): 0.8979591836734694, (0, 2): 0.08163265306122448}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 88.0 -> 89.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 88.0 -> 89.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 168.0}
in get_filtered_urn(filter=1) --- total: total=170.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0058823529411764705, (1, 1): 0.0058823529411764705, (1, 2): 0.9882352941176471}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0058823529411764705, (1, 1): 0.0058823529411764705, (1, 2): 0.9882352941176471}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 168.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=170.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0058823529411764705, (2, 1): 0.9882352941176471, (2, 2): 0.0058823529411764705}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0058823529411764705, (2, 1): 0.9882352941176471, (2, 2): 0.0058823529411764705}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 168.0 -> 169.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 168.0 -> 169.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 77.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=87.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09195402298850575, (2, 1): 0.8850574712643678, (2, 2): 0.022988505747126436}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.09195402298850575, (2, 1): 0.8850574712643678, (2, 2): 0.022988505747126436}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 77.0}
in get_filtered_urn(filter=1) --- total: total=89.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.11235955056179775, (1, 1): 0.02247191011235955, (1, 2): 0.8651685393258427}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.11235955056179775, (1, 1): 0.02247191011235955, (1, 2): 0.8651685393258427}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 77.0 -> 78.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 77.0 -> 78.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 169.0}
in get_filtered_urn(filter=1) --- total: total=171.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005847953216374269, (1, 1): 0.005847953216374269, (1, 2): 0.9883040935672515}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005847953216374269, (1, 1): 0.005847953216374269, (1, 2): 0.9883040935672515}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 169.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=171.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005847953216374269, (2, 1): 0.9883040935672515, (2, 2): 0.005847953216374269}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005847953216374269, (2, 1): 0.9883040935672515, (2, 2): 0.005847953216374269}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 169.0 -> 170.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 169.0 -> 170.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 89.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=95.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9368421052631579, (1, 1): 0.021052631578947368, (1, 2): 0.042105263157894736}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9368421052631579, (1, 1): 0.021052631578947368, (1, 2): 0.042105263157894736}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 89.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=99.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.020202020202020204, (0, 1): 0.898989898989899, (0, 2): 0.08080808080808081}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.020202020202020204, (0, 1): 0.898989898989899, (0, 2): 0.08080808080808081}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 89.0 -> 90.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 89.0 -> 90.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 118.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=120.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008333333333333333, (0, 1): 0.9833333333333333, (0, 2): 0.008333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008333333333333333, (0, 1): 0.9833333333333333, (0, 2): 0.008333333333333333}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 118.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=123.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.959349593495935, (1, 1): 0.008130081300813009, (1, 2): 0.032520325203252036}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.959349593495935, (1, 1): 0.008130081300813009, (1, 2): 0.032520325203252036}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 118.0 -> 119.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 118.0 -> 119.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 78.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=88.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09090909090909091, (2, 1): 0.8863636363636364, (2, 2): 0.022727272727272728}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.09090909090909091, (2, 1): 0.8863636363636364, (2, 2): 0.022727272727272728}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 78.0}
in get_filtered_urn(filter=1) --- total: total=90.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.1111111111111111, (1, 1): 0.022222222222222223, (1, 2): 0.8666666666666667}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.1111111111111111, (1, 1): 0.022222222222222223, (1, 2): 0.8666666666666667}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 78.0 -> 79.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 78.0 -> 79.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 119.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=121.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008264462809917356, (0, 1): 0.9834710743801653, (0, 2): 0.008264462809917356}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008264462809917356, (0, 1): 0.9834710743801653, (0, 2): 0.008264462809917356}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 119.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=124.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9596774193548387, (1, 1): 0.008064516129032258, (1, 2): 0.03225806451612903}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9596774193548387, (1, 1): 0.008064516129032258, (1, 2): 0.03225806451612903}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 119.0 -> 120.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 119.0 -> 120.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 93.0}
in get_filtered_urn(filter=0) --- total: total=105.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01904761904761905, (0, 1): 0.09523809523809523, (0, 2): 0.8857142857142857}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.01904761904761905, (0, 1): 0.09523809523809523, (0, 2): 0.8857142857142857}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 79.0}
in get_filtered_urn(filter=1) --- total: total=91.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.10989010989010989, (1, 1): 0.02197802197802198, (1, 2): 0.8681318681318682}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.10989010989010989, (1, 1): 0.02197802197802198, (1, 2): 0.8681318681318682}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 79.0 -> 79.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 170.0}
in get_filtered_urn(filter=1) --- total: total=172.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005813953488372093, (1, 1): 0.005813953488372093, (1, 2): 0.9883720930232558}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005813953488372093, (1, 1): 0.005813953488372093, (1, 2): 0.9883720930232558}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 170.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=172.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005813953488372093, (2, 1): 0.9883720930232558, (2, 2): 0.005813953488372093}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005813953488372093, (2, 1): 0.9883720930232558, (2, 2): 0.005813953488372093}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 170.0 -> 171.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 170.0 -> 171.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 90.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=96.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9375, (1, 1): 0.020833333333333332, (1, 2): 0.041666666666666664}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9375, (1, 1): 0.020833333333333332, (1, 2): 0.041666666666666664}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 90.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=100.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.02, (0, 1): 0.9, (0, 2): 0.08}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.02, (0, 1): 0.9, (0, 2): 0.08}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 90.0 -> 91.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 90.0 -> 91.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 104.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=109.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9541284403669725, (2, 1): 0.03669724770642202, (2, 2): 0.009174311926605505}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9541284403669725, (2, 1): 0.03669724770642202, (2, 2): 0.009174311926605505}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 104.0}
in get_filtered_urn(filter=0) --- total: total=106.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009433962264150943, (0, 1): 0.009433962264150943, (0, 2): 0.9811320754716981}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009433962264150943, (0, 1): 0.009433962264150943, (0, 2): 0.9811320754716981}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 104.0 -> 105.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 104.0 -> 105.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 91.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=97.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9381443298969072, (1, 1): 0.020618556701030927, (1, 2): 0.041237113402061855}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9381443298969072, (1, 1): 0.020618556701030927, (1, 2): 0.041237113402061855}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 91.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=101.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.019801980198019802, (0, 1): 0.900990099009901, (0, 2): 0.07920792079207921}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.019801980198019802, (0, 1): 0.900990099009901, (0, 2): 0.07920792079207921}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 91.0 -> 91.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 8.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 105.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=110.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9545454545454546, (2, 1): 0.03636363636363636, (2, 2): 0.00909090909090909}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9545454545454546, (2, 1): 0.03636363636363636, (2, 2): 0.00909090909090909}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 105.0}
in get_filtered_urn(filter=0) --- total: total=107.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009345794392523364, (0, 1): 0.009345794392523364, (0, 2): 0.9813084112149533}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009345794392523364, (0, 1): 0.009345794392523364, (0, 2): 0.9813084112149533}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 105.0 -> 106.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 105.0 -> 106.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 91.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=97.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9381443298969072, (1, 1): 0.020618556701030927, (1, 2): 0.041237113402061855}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9381443298969072, (1, 1): 0.020618556701030927, (1, 2): 0.041237113402061855}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 91.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=101.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.019801980198019802, (0, 1): 0.900990099009901, (0, 2): 0.07920792079207921}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.019801980198019802, (0, 1): 0.900990099009901, (0, 2): 0.07920792079207921}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 91.0 -> 92.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 91.0 -> 92.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 171.0}
in get_filtered_urn(filter=1) --- total: total=173.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005780346820809248, (1, 1): 0.005780346820809248, (1, 2): 0.9884393063583815}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005780346820809248, (1, 1): 0.005780346820809248, (1, 2): 0.9884393063583815}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 171.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=173.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005780346820809248, (2, 1): 0.9884393063583815, (2, 2): 0.005780346820809248}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005780346820809248, (2, 1): 0.9884393063583815, (2, 2): 0.005780346820809248}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 171.0 -> 172.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 171.0 -> 172.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 93.0}
in get_filtered_urn(filter=0) --- total: total=105.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01904761904761905, (0, 1): 0.09523809523809523, (0, 2): 0.8857142857142857}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.01904761904761905, (0, 1): 0.09523809523809523, (0, 2): 0.8857142857142857}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 93.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=99.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9393939393939394, (2, 1): 0.04040404040404041, (2, 2): 0.020202020202020204}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9393939393939394, (2, 1): 0.04040404040404041, (2, 2): 0.020202020202020204}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 93.0 -> 94.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 93.0 -> 94.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 172.0}
in get_filtered_urn(filter=1) --- total: total=174.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005747126436781609, (1, 1): 0.005747126436781609, (1, 2): 0.9885057471264368}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005747126436781609, (1, 1): 0.005747126436781609, (1, 2): 0.9885057471264368}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 172.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=174.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005747126436781609, (2, 1): 0.9885057471264368, (2, 2): 0.005747126436781609}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005747126436781609, (2, 1): 0.9885057471264368, (2, 2): 0.005747126436781609}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 172.0 -> 173.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 172.0 -> 173.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 92.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=98.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9387755102040817, (1, 1): 0.02040816326530612, (1, 2): 0.04081632653061224}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9387755102040817, (1, 1): 0.02040816326530612, (1, 2): 0.04081632653061224}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 92.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=102.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0196078431372549, (0, 1): 0.9019607843137255, (0, 2): 0.0784313725490196}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0196078431372549, (0, 1): 0.9019607843137255, (0, 2): 0.0784313725490196}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 92.0 -> 93.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 92.0 -> 93.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 173.0}
in get_filtered_urn(filter=1) --- total: total=175.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005714285714285714, (1, 1): 0.005714285714285714, (1, 2): 0.9885714285714285}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005714285714285714, (1, 1): 0.005714285714285714, (1, 2): 0.9885714285714285}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 173.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=175.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005714285714285714, (2, 1): 0.9885714285714285, (2, 2): 0.005714285714285714}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005714285714285714, (2, 1): 0.9885714285714285, (2, 2): 0.005714285714285714}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 173.0 -> 174.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 173.0 -> 174.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 94.0}
in get_filtered_urn(filter=0) --- total: total=106.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.018867924528301886, (0, 1): 0.09433962264150944, (0, 2): 0.8867924528301887}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.018867924528301886, (0, 1): 0.09433962264150944, (0, 2): 0.8867924528301887}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 94.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=100.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.94, (2, 1): 0.04, (2, 2): 0.02}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.94, (2, 1): 0.04, (2, 2): 0.02}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 94.0 -> 95.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 94.0 -> 95.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 174.0}
in get_filtered_urn(filter=1) --- total: total=176.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005681818181818182, (1, 1): 0.005681818181818182, (1, 2): 0.9886363636363636}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005681818181818182, (1, 1): 0.005681818181818182, (1, 2): 0.9886363636363636}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 174.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=176.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005681818181818182, (2, 1): 0.9886363636363636, (2, 2): 0.005681818181818182}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005681818181818182, (2, 1): 0.9886363636363636, (2, 2): 0.005681818181818182}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 174.0 -> 175.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 174.0 -> 175.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 95.0}
in get_filtered_urn(filter=0) --- total: total=107.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.018691588785046728, (0, 1): 0.09345794392523364, (0, 2): 0.8878504672897196}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.018691588785046728, (0, 1): 0.09345794392523364, (0, 2): 0.8878504672897196}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 95.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=101.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9405940594059405, (2, 1): 0.039603960396039604, (2, 2): 0.019801980198019802}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9405940594059405, (2, 1): 0.039603960396039604, (2, 2): 0.019801980198019802}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 95.0 -> 96.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 95.0 -> 96.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 120.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=122.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00819672131147541, (0, 1): 0.9836065573770492, (0, 2): 0.00819672131147541}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00819672131147541, (0, 1): 0.9836065573770492, (0, 2): 0.00819672131147541}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 120.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=125.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.96, (1, 1): 0.008, (1, 2): 0.032}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.96, (1, 1): 0.008, (1, 2): 0.032}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 120.0 -> 121.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 120.0 -> 121.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 93.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=99.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9393939393939394, (1, 1): 0.020202020202020204, (1, 2): 0.04040404040404041}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9393939393939394, (1, 1): 0.020202020202020204, (1, 2): 0.04040404040404041}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 93.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=103.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.019417475728155338, (0, 1): 0.9029126213592233, (0, 2): 0.07766990291262135}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.019417475728155338, (0, 1): 0.9029126213592233, (0, 2): 0.07766990291262135}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 93.0 -> 94.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 93.0 -> 94.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 106.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=111.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.954954954954955, (2, 1): 0.036036036036036036, (2, 2): 0.009009009009009009}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.954954954954955, (2, 1): 0.036036036036036036, (2, 2): 0.009009009009009009}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 106.0}
in get_filtered_urn(filter=0) --- total: total=108.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009259259259259259, (0, 1): 0.009259259259259259, (0, 2): 0.9814814814814815}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009259259259259259, (0, 1): 0.009259259259259259, (0, 2): 0.9814814814814815}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 106.0 -> 107.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 106.0 -> 107.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 79.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=89.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0898876404494382, (2, 1): 0.8876404494382022, (2, 2): 0.02247191011235955}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0898876404494382, (2, 1): 0.8876404494382022, (2, 2): 0.02247191011235955}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 79.0}
in get_filtered_urn(filter=1) --- total: total=91.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.10989010989010989, (1, 1): 0.02197802197802198, (1, 2): 0.8681318681318682}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.10989010989010989, (1, 1): 0.02197802197802198, (1, 2): 0.8681318681318682}
in decode_message(signal=1) Receiver 5 got option: (1, 1) and decoded action: 1
Receiver 5 received signals: [1] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 79.0 -> 79.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 1): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 121.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=123.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008130081300813009, (0, 1): 0.983739837398374, (0, 2): 0.008130081300813009}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008130081300813009, (0, 1): 0.983739837398374, (0, 2): 0.008130081300813009}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 121.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=126.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9603174603174603, (1, 1): 0.007936507936507936, (1, 2): 0.031746031746031744}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9603174603174603, (1, 1): 0.007936507936507936, (1, 2): 0.031746031746031744}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 121.0 -> 122.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 121.0 -> 122.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 96.0}
in get_filtered_urn(filter=0) --- total: total=108.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.018518518518518517, (0, 1): 0.09259259259259259, (0, 2): 0.8888888888888888}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.018518518518518517, (0, 1): 0.09259259259259259, (0, 2): 0.8888888888888888}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 96.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=102.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9411764705882353, (2, 1): 0.0392156862745098, (2, 2): 0.0196078431372549}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9411764705882353, (2, 1): 0.0392156862745098, (2, 2): 0.0196078431372549}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 96.0 -> 97.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 96.0 -> 97.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 122.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=124.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008064516129032258, (0, 1): 0.9838709677419355, (0, 2): 0.008064516129032258}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008064516129032258, (0, 1): 0.9838709677419355, (0, 2): 0.008064516129032258}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 122.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=127.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9606299212598425, (1, 1): 0.007874015748031496, (1, 2): 0.031496062992125984}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9606299212598425, (1, 1): 0.007874015748031496, (1, 2): 0.031496062992125984}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 122.0 -> 123.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 122.0 -> 123.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 94.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=100.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.94, (1, 1): 0.02, (1, 2): 0.04}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.94, (1, 1): 0.02, (1, 2): 0.04}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 94.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=104.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.019230769230769232, (0, 1): 0.9038461538461539, (0, 2): 0.07692307692307693}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.019230769230769232, (0, 1): 0.9038461538461539, (0, 2): 0.07692307692307693}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 94.0 -> 95.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 94.0 -> 95.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 123.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=125.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008, (0, 1): 0.984, (0, 2): 0.008}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008, (0, 1): 0.984, (0, 2): 0.008}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 123.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=128.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9609375, (1, 1): 0.0078125, (1, 2): 0.03125}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9609375, (1, 1): 0.0078125, (1, 2): 0.03125}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 123.0 -> 124.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 123.0 -> 124.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 95.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=101.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9405940594059405, (1, 1): 0.019801980198019802, (1, 2): 0.039603960396039604}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9405940594059405, (1, 1): 0.019801980198019802, (1, 2): 0.039603960396039604}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 95.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=105.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01904761904761905, (0, 1): 0.9047619047619048, (0, 2): 0.0761904761904762}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.01904761904761905, (0, 1): 0.9047619047619048, (0, 2): 0.0761904761904762}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 95.0 -> 96.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 95.0 -> 96.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 124.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=126.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007936507936507936, (0, 1): 0.9841269841269841, (0, 2): 0.007936507936507936}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.007936507936507936, (0, 1): 0.9841269841269841, (0, 2): 0.007936507936507936}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 124.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=129.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9612403100775194, (1, 1): 0.007751937984496124, (1, 2): 0.031007751937984496}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.9612403100775194, (1, 1): 0.007751937984496124, (1, 2): 0.031007751937984496}
in decode_message(signal=1) Receiver 2 got option: (1, 1) and decoded action: 1
Receiver 2 received signals: [1] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 1): 124.0 -> 124.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 1): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 79.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=89.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0898876404494382, (2, 1): 0.8876404494382022, (2, 2): 0.02247191011235955}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0898876404494382, (2, 1): 0.8876404494382022, (2, 2): 0.02247191011235955}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 79.0}
in get_filtered_urn(filter=1) --- total: total=91.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.10989010989010989, (1, 1): 0.02197802197802198, (1, 2): 0.8681318681318682}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.10989010989010989, (1, 1): 0.02197802197802198, (1, 2): 0.8681318681318682}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 79.0 -> 80.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 79.0 -> 80.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 124.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=126.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007936507936507936, (0, 1): 0.9841269841269841, (0, 2): 0.007936507936507936}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.007936507936507936, (0, 1): 0.9841269841269841, (0, 2): 0.007936507936507936}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 124.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=129.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9612403100775194, (1, 1): 0.007751937984496124, (1, 2): 0.031007751937984496}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9612403100775194, (1, 1): 0.007751937984496124, (1, 2): 0.031007751937984496}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 124.0 -> 125.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 124.0 -> 125.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 96.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=102.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9411764705882353, (1, 1): 0.0196078431372549, (1, 2): 0.0392156862745098}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9411764705882353, (1, 1): 0.0196078431372549, (1, 2): 0.0392156862745098}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 96.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=106.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.018867924528301886, (0, 1): 0.9056603773584906, (0, 2): 0.07547169811320754}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.018867924528301886, (0, 1): 0.9056603773584906, (0, 2): 0.07547169811320754}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 96.0 -> 97.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 96.0 -> 97.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 107.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=112.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9553571428571429, (2, 1): 0.03571428571428571, (2, 2): 0.008928571428571428}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9553571428571429, (2, 1): 0.03571428571428571, (2, 2): 0.008928571428571428}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 107.0}
in get_filtered_urn(filter=0) --- total: total=109.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009174311926605505, (0, 1): 0.009174311926605505, (0, 2): 0.981651376146789}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009174311926605505, (0, 1): 0.009174311926605505, (0, 2): 0.981651376146789}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 107.0 -> 108.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 107.0 -> 108.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 97.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=103.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.941747572815534, (1, 1): 0.019417475728155338, (1, 2): 0.038834951456310676}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.941747572815534, (1, 1): 0.019417475728155338, (1, 2): 0.038834951456310676}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 97.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=107.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.018691588785046728, (0, 1): 0.9065420560747663, (0, 2): 0.07476635514018691}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.018691588785046728, (0, 1): 0.9065420560747663, (0, 2): 0.07476635514018691}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 97.0 -> 97.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 8.0 -> 8.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 175.0}
in get_filtered_urn(filter=1) --- total: total=177.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005649717514124294, (1, 1): 0.005649717514124294, (1, 2): 0.9887005649717514}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005649717514124294, (1, 1): 0.005649717514124294, (1, 2): 0.9887005649717514}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 175.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=177.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005649717514124294, (2, 1): 0.9887005649717514, (2, 2): 0.005649717514124294}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005649717514124294, (2, 1): 0.9887005649717514, (2, 2): 0.005649717514124294}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 175.0 -> 176.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 175.0 -> 176.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 80.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=90.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.08888888888888889, (2, 1): 0.8888888888888888, (2, 2): 0.022222222222222223}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.08888888888888889, (2, 1): 0.8888888888888888, (2, 2): 0.022222222222222223}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 80.0}
in get_filtered_urn(filter=1) --- total: total=92.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.10869565217391304, (1, 1): 0.021739130434782608, (1, 2): 0.8695652173913043}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.10869565217391304, (1, 1): 0.021739130434782608, (1, 2): 0.8695652173913043}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 80.0 -> 81.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 80.0 -> 81.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 108.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=113.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9557522123893806, (2, 1): 0.035398230088495575, (2, 2): 0.008849557522123894}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9557522123893806, (2, 1): 0.035398230088495575, (2, 2): 0.008849557522123894}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 108.0}
in get_filtered_urn(filter=0) --- total: total=110.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00909090909090909, (0, 1): 0.00909090909090909, (0, 2): 0.9818181818181818}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00909090909090909, (0, 1): 0.00909090909090909, (0, 2): 0.9818181818181818}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 108.0 -> 109.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 108.0 -> 109.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 81.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=91.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.08791208791208792, (2, 1): 0.8901098901098901, (2, 2): 0.02197802197802198}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.08791208791208792, (2, 1): 0.8901098901098901, (2, 2): 0.02197802197802198}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 81.0}
in get_filtered_urn(filter=1) --- total: total=93.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.10752688172043011, (1, 1): 0.021505376344086023, (1, 2): 0.8709677419354839}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.10752688172043011, (1, 1): 0.021505376344086023, (1, 2): 0.8709677419354839}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 81.0 -> 82.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 81.0 -> 82.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 125.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=127.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007874015748031496, (0, 1): 0.984251968503937, (0, 2): 0.007874015748031496}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.007874015748031496, (0, 1): 0.984251968503937, (0, 2): 0.007874015748031496}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 125.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=130.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9615384615384616, (1, 1): 0.007692307692307693, (1, 2): 0.03076923076923077}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9615384615384616, (1, 1): 0.007692307692307693, (1, 2): 0.03076923076923077}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 125.0 -> 126.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 125.0 -> 126.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 97.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=103.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.941747572815534, (1, 1): 0.019417475728155338, (1, 2): 0.038834951456310676}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.941747572815534, (1, 1): 0.019417475728155338, (1, 2): 0.038834951456310676}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 97.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=107.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.018691588785046728, (0, 1): 0.9065420560747663, (0, 2): 0.07476635514018691}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.018691588785046728, (0, 1): 0.9065420560747663, (0, 2): 0.07476635514018691}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 97.0 -> 98.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 97.0 -> 98.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 109.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=114.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.956140350877193, (2, 1): 0.03508771929824561, (2, 2): 0.008771929824561403}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.956140350877193, (2, 1): 0.03508771929824561, (2, 2): 0.008771929824561403}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 109.0}
in get_filtered_urn(filter=0) --- total: total=111.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009009009009009009, (0, 1): 0.009009009009009009, (0, 2): 0.9819819819819819}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009009009009009009, (0, 1): 0.009009009009009009, (0, 2): 0.9819819819819819}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 109.0 -> 110.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 109.0 -> 110.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 98.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=104.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9423076923076923, (1, 1): 0.019230769230769232, (1, 2): 0.038461538461538464}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.9423076923076923, (1, 1): 0.019230769230769232, (1, 2): 0.038461538461538464}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 97.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=103.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.941747572815534, (2, 1): 0.038834951456310676, (2, 2): 0.019417475728155338}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.941747572815534, (2, 1): 0.038834951456310676, (2, 2): 0.019417475728155338}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 97.0 -> 97.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 126.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=128.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0078125, (0, 1): 0.984375, (0, 2): 0.0078125}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0078125, (0, 1): 0.984375, (0, 2): 0.0078125}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 126.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=131.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9618320610687023, (1, 1): 0.007633587786259542, (1, 2): 0.030534351145038167}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9618320610687023, (1, 1): 0.007633587786259542, (1, 2): 0.030534351145038167}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 126.0 -> 127.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 126.0 -> 127.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 97.0}
in get_filtered_urn(filter=0) --- total: total=109.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01834862385321101, (0, 1): 0.09174311926605505, (0, 2): 0.8899082568807339}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.01834862385321101, (0, 1): 0.09174311926605505, (0, 2): 0.8899082568807339}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 97.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=103.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.941747572815534, (2, 1): 0.038834951456310676, (2, 2): 0.019417475728155338}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.941747572815534, (2, 1): 0.038834951456310676, (2, 2): 0.019417475728155338}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 97.0 -> 98.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 97.0 -> 98.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 110.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=115.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9565217391304348, (2, 1): 0.034782608695652174, (2, 2): 0.008695652173913044}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.9565217391304348, (2, 1): 0.034782608695652174, (2, 2): 0.008695652173913044}
Sender 1 got filter 2 choose option: (2, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 176.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=178.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0056179775280898875, (2, 1): 0.9887640449438202, (2, 2): 0.0056179775280898875}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0056179775280898875, (2, 1): 0.9887640449438202, (2, 2): 0.0056179775280898875}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 2): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 1): 176.0 -> 176.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 82.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=92.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.08695652173913043, (2, 1): 0.8913043478260869, (2, 2): 0.021739130434782608}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.08695652173913043, (2, 1): 0.8913043478260869, (2, 2): 0.021739130434782608}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 82.0}
in get_filtered_urn(filter=1) --- total: total=94.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.10638297872340426, (1, 1): 0.02127659574468085, (1, 2): 0.8723404255319149}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.10638297872340426, (1, 1): 0.02127659574468085, (1, 2): 0.8723404255319149}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 82.0 -> 82.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 110.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=115.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9565217391304348, (2, 1): 0.034782608695652174, (2, 2): 0.008695652173913044}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9565217391304348, (2, 1): 0.034782608695652174, (2, 2): 0.008695652173913044}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 110.0}
in get_filtered_urn(filter=0) --- total: total=112.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008928571428571428, (0, 1): 0.008928571428571428, (0, 2): 0.9821428571428571}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008928571428571428, (0, 1): 0.008928571428571428, (0, 2): 0.9821428571428571}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 110.0 -> 111.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 110.0 -> 111.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 98.0}
in get_filtered_urn(filter=0) --- total: total=110.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01818181818181818, (0, 1): 0.09090909090909091, (0, 2): 0.8909090909090909}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.01818181818181818, (0, 1): 0.09090909090909091, (0, 2): 0.8909090909090909}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 98.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=104.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9423076923076923, (2, 1): 0.038461538461538464, (2, 2): 0.019230769230769232}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9423076923076923, (2, 1): 0.038461538461538464, (2, 2): 0.019230769230769232}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 98.0 -> 99.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 98.0 -> 99.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 176.0}
in get_filtered_urn(filter=1) --- total: total=178.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0056179775280898875, (1, 1): 0.0056179775280898875, (1, 2): 0.9887640449438202}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0056179775280898875, (1, 1): 0.0056179775280898875, (1, 2): 0.9887640449438202}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 176.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=178.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0056179775280898875, (2, 1): 0.9887640449438202, (2, 2): 0.0056179775280898875}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0056179775280898875, (2, 1): 0.9887640449438202, (2, 2): 0.0056179775280898875}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 176.0 -> 177.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 176.0 -> 177.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 99.0}
in get_filtered_urn(filter=0) --- total: total=111.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.018018018018018018, (0, 1): 0.09009009009009009, (0, 2): 0.8918918918918919}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.018018018018018018, (0, 1): 0.09009009009009009, (0, 2): 0.8918918918918919}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 99.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=105.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9428571428571428, (2, 1): 0.0380952380952381, (2, 2): 0.01904761904761905}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9428571428571428, (2, 1): 0.0380952380952381, (2, 2): 0.01904761904761905}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 99.0 -> 100.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 99.0 -> 100.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 177.0}
in get_filtered_urn(filter=1) --- total: total=179.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.00558659217877095, (1, 1): 0.00558659217877095, (1, 2): 0.9888268156424581}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.00558659217877095, (1, 1): 0.00558659217877095, (1, 2): 0.9888268156424581}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 177.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=179.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.00558659217877095, (2, 1): 0.9888268156424581, (2, 2): 0.00558659217877095}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.00558659217877095, (2, 1): 0.9888268156424581, (2, 2): 0.00558659217877095}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 177.0 -> 178.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 177.0 -> 178.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 100.0}
in get_filtered_urn(filter=0) --- total: total=112.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.017857142857142856, (0, 1): 0.08928571428571429, (0, 2): 0.8928571428571429}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.017857142857142856, (0, 1): 0.08928571428571429, (0, 2): 0.8928571428571429}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 100.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=106.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9433962264150944, (2, 1): 0.03773584905660377, (2, 2): 0.018867924528301886}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9433962264150944, (2, 1): 0.03773584905660377, (2, 2): 0.018867924528301886}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 100.0 -> 101.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 100.0 -> 101.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 127.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=129.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007751937984496124, (0, 1): 0.9844961240310077, (0, 2): 0.007751937984496124}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.007751937984496124, (0, 1): 0.9844961240310077, (0, 2): 0.007751937984496124}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 127.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=132.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9621212121212122, (1, 1): 0.007575757575757576, (1, 2): 0.030303030303030304}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9621212121212122, (1, 1): 0.007575757575757576, (1, 2): 0.030303030303030304}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 127.0 -> 128.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 127.0 -> 128.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 98.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=104.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9423076923076923, (1, 1): 0.019230769230769232, (1, 2): 0.038461538461538464}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9423076923076923, (1, 1): 0.019230769230769232, (1, 2): 0.038461538461538464}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 98.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=108.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.018518518518518517, (0, 1): 0.9074074074074074, (0, 2): 0.07407407407407407}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.018518518518518517, (0, 1): 0.9074074074074074, (0, 2): 0.07407407407407407}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 98.0 -> 99.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 98.0 -> 99.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 128.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=130.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007692307692307693, (0, 1): 0.9846153846153847, (0, 2): 0.007692307692307693}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.007692307692307693, (0, 1): 0.9846153846153847, (0, 2): 0.007692307692307693}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 128.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=133.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9624060150375939, (1, 1): 0.007518796992481203, (1, 2): 0.03007518796992481}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9624060150375939, (1, 1): 0.007518796992481203, (1, 2): 0.03007518796992481}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 128.0 -> 129.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 128.0 -> 129.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 8.0, (2, 1): 82.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=92.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.08695652173913043, (2, 1): 0.8913043478260869, (2, 2): 0.021739130434782608}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.08695652173913043, (2, 1): 0.8913043478260869, (2, 2): 0.021739130434782608}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 99.0, (0, 2): 8.0}
in get_filtered_urn(filter=0) --- total: total=109.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01834862385321101, (0, 1): 0.908256880733945, (0, 2): 0.07339449541284404}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.01834862385321101, (0, 1): 0.908256880733945, (0, 2): 0.07339449541284404}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 0): 8.0 -> 9.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 2): 8.0 -> 9.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 178.0}
in get_filtered_urn(filter=1) --- total: total=180.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005555555555555556, (1, 1): 0.005555555555555556, (1, 2): 0.9888888888888889}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005555555555555556, (1, 1): 0.005555555555555556, (1, 2): 0.9888888888888889}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 178.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=180.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005555555555555556, (2, 1): 0.9888888888888889, (2, 2): 0.005555555555555556}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005555555555555556, (2, 1): 0.9888888888888889, (2, 2): 0.005555555555555556}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 178.0 -> 179.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 178.0 -> 179.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 101.0}
in get_filtered_urn(filter=0) --- total: total=113.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.017699115044247787, (0, 1): 0.08849557522123894, (0, 2): 0.8938053097345132}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.017699115044247787, (0, 1): 0.08849557522123894, (0, 2): 0.8938053097345132}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 101.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=107.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9439252336448598, (2, 1): 0.037383177570093455, (2, 2): 0.018691588785046728}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9439252336448598, (2, 1): 0.037383177570093455, (2, 2): 0.018691588785046728}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 101.0 -> 102.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 101.0 -> 102.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 179.0}
in get_filtered_urn(filter=1) --- total: total=181.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0055248618784530384, (1, 1): 0.0055248618784530384, (1, 2): 0.988950276243094}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0055248618784530384, (1, 1): 0.0055248618784530384, (1, 2): 0.988950276243094}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 179.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=181.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0055248618784530384, (2, 1): 0.988950276243094, (2, 2): 0.0055248618784530384}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0055248618784530384, (2, 1): 0.988950276243094, (2, 2): 0.0055248618784530384}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 179.0 -> 180.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 179.0 -> 180.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 82.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=93.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0967741935483871, (2, 1): 0.8817204301075269, (2, 2): 0.021505376344086023}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0967741935483871, (2, 1): 0.8817204301075269, (2, 2): 0.021505376344086023}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 82.0}
in get_filtered_urn(filter=1) --- total: total=94.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.10638297872340426, (1, 1): 0.02127659574468085, (1, 2): 0.8723404255319149}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.10638297872340426, (1, 1): 0.02127659574468085, (1, 2): 0.8723404255319149}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 82.0 -> 83.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 82.0 -> 83.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 129.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=131.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007633587786259542, (0, 1): 0.9847328244274809, (0, 2): 0.007633587786259542}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.007633587786259542, (0, 1): 0.9847328244274809, (0, 2): 0.007633587786259542}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 129.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=134.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9626865671641791, (1, 1): 0.007462686567164179, (1, 2): 0.029850746268656716}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9626865671641791, (1, 1): 0.007462686567164179, (1, 2): 0.029850746268656716}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 129.0 -> 130.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 129.0 -> 130.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 99.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=105.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9428571428571428, (1, 1): 0.01904761904761905, (1, 2): 0.0380952380952381}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9428571428571428, (1, 1): 0.01904761904761905, (1, 2): 0.0380952380952381}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 99.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=110.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01818181818181818, (0, 1): 0.9, (0, 2): 0.08181818181818182}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.01818181818181818, (0, 1): 0.9, (0, 2): 0.08181818181818182}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 99.0 -> 100.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 99.0 -> 100.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 130.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=132.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007575757575757576, (0, 1): 0.9848484848484849, (0, 2): 0.007575757575757576}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.007575757575757576, (0, 1): 0.9848484848484849, (0, 2): 0.007575757575757576}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 130.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=135.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9629629629629629, (1, 1): 0.007407407407407408, (1, 2): 0.02962962962962963}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9629629629629629, (1, 1): 0.007407407407407408, (1, 2): 0.02962962962962963}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 130.0 -> 131.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 130.0 -> 131.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 83.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=94.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09574468085106383, (2, 1): 0.8829787234042553, (2, 2): 0.02127659574468085}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.09574468085106383, (2, 1): 0.8829787234042553, (2, 2): 0.02127659574468085}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 83.0}
in get_filtered_urn(filter=1) --- total: total=95.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.10526315789473684, (1, 1): 0.021052631578947368, (1, 2): 0.8736842105263158}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.10526315789473684, (1, 1): 0.021052631578947368, (1, 2): 0.8736842105263158}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 83.0 -> 84.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 83.0 -> 84.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 180.0}
in get_filtered_urn(filter=1) --- total: total=182.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005494505494505495, (1, 1): 0.005494505494505495, (1, 2): 0.989010989010989}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005494505494505495, (1, 1): 0.005494505494505495, (1, 2): 0.989010989010989}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 180.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=182.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005494505494505495, (2, 1): 0.989010989010989, (2, 2): 0.005494505494505495}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005494505494505495, (2, 1): 0.989010989010989, (2, 2): 0.005494505494505495}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 180.0 -> 181.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 180.0 -> 181.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 102.0}
in get_filtered_urn(filter=0) --- total: total=114.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.017543859649122806, (0, 1): 0.08771929824561403, (0, 2): 0.8947368421052632}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.017543859649122806, (0, 1): 0.08771929824561403, (0, 2): 0.8947368421052632}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 102.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=108.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9444444444444444, (2, 1): 0.037037037037037035, (2, 2): 0.018518518518518517}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9444444444444444, (2, 1): 0.037037037037037035, (2, 2): 0.018518518518518517}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 102.0 -> 103.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 102.0 -> 103.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 131.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=133.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007518796992481203, (0, 1): 0.9849624060150376, (0, 2): 0.007518796992481203}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.007518796992481203, (0, 1): 0.9849624060150376, (0, 2): 0.007518796992481203}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 131.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=136.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9632352941176471, (1, 1): 0.007352941176470588, (1, 2): 0.029411764705882353}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9632352941176471, (1, 1): 0.007352941176470588, (1, 2): 0.029411764705882353}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 131.0 -> 132.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 131.0 -> 132.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 100.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=106.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9433962264150944, (1, 1): 0.018867924528301886, (1, 2): 0.03773584905660377}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9433962264150944, (1, 1): 0.018867924528301886, (1, 2): 0.03773584905660377}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 100.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=111.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.018018018018018018, (0, 1): 0.9009009009009009, (0, 2): 0.08108108108108109}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.018018018018018018, (0, 1): 0.9009009009009009, (0, 2): 0.08108108108108109}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 100.0 -> 101.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 100.0 -> 101.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 132.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=134.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007462686567164179, (0, 1): 0.9850746268656716, (0, 2): 0.007462686567164179}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.007462686567164179, (0, 1): 0.9850746268656716, (0, 2): 0.007462686567164179}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 132.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=137.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9635036496350365, (1, 1): 0.0072992700729927005, (1, 2): 0.029197080291970802}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9635036496350365, (1, 1): 0.0072992700729927005, (1, 2): 0.029197080291970802}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 132.0 -> 133.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 132.0 -> 133.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 103.0}
in get_filtered_urn(filter=0) --- total: total=115.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.017391304347826087, (0, 1): 0.08695652173913043, (0, 2): 0.8956521739130435}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.017391304347826087, (0, 1): 0.08695652173913043, (0, 2): 0.8956521739130435}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 103.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=109.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.944954128440367, (2, 1): 0.03669724770642202, (2, 2): 0.01834862385321101}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.944954128440367, (2, 1): 0.03669724770642202, (2, 2): 0.01834862385321101}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 103.0 -> 104.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 103.0 -> 104.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 181.0}
in get_filtered_urn(filter=1) --- total: total=183.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.00546448087431694, (1, 1): 0.00546448087431694, (1, 2): 0.9890710382513661}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.00546448087431694, (1, 1): 0.00546448087431694, (1, 2): 0.9890710382513661}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 181.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=183.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.00546448087431694, (2, 1): 0.9890710382513661, (2, 2): 0.00546448087431694}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.00546448087431694, (2, 1): 0.9890710382513661, (2, 2): 0.00546448087431694}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 181.0 -> 182.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 181.0 -> 182.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 104.0}
in get_filtered_urn(filter=0) --- total: total=116.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.017241379310344827, (0, 1): 0.08620689655172414, (0, 2): 0.896551724137931}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.017241379310344827, (0, 1): 0.08620689655172414, (0, 2): 0.896551724137931}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 104.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=110.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9454545454545454, (2, 1): 0.03636363636363636, (2, 2): 0.01818181818181818}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9454545454545454, (2, 1): 0.03636363636363636, (2, 2): 0.01818181818181818}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 104.0 -> 105.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 104.0 -> 105.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 111.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=116.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9568965517241379, (2, 1): 0.034482758620689655, (2, 2): 0.008620689655172414}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9568965517241379, (2, 1): 0.034482758620689655, (2, 2): 0.008620689655172414}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 111.0}
in get_filtered_urn(filter=0) --- total: total=113.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008849557522123894, (0, 1): 0.008849557522123894, (0, 2): 0.9823008849557522}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008849557522123894, (0, 1): 0.008849557522123894, (0, 2): 0.9823008849557522}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 111.0 -> 112.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 111.0 -> 112.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 84.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=95.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09473684210526316, (2, 1): 0.8842105263157894, (2, 2): 0.021052631578947368}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.09473684210526316, (2, 1): 0.8842105263157894, (2, 2): 0.021052631578947368}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 84.0}
in get_filtered_urn(filter=1) --- total: total=96.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.10416666666666667, (1, 1): 0.020833333333333332, (1, 2): 0.875}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.10416666666666667, (1, 1): 0.020833333333333332, (1, 2): 0.875}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 84.0 -> 84.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 112.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=117.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9572649572649573, (2, 1): 0.03418803418803419, (2, 2): 0.008547008547008548}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9572649572649573, (2, 1): 0.03418803418803419, (2, 2): 0.008547008547008548}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 112.0}
in get_filtered_urn(filter=0) --- total: total=114.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008771929824561403, (0, 1): 0.008771929824561403, (0, 2): 0.9824561403508771}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008771929824561403, (0, 1): 0.008771929824561403, (0, 2): 0.9824561403508771}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 112.0 -> 113.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 112.0 -> 113.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 105.0}
in get_filtered_urn(filter=0) --- total: total=117.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.017094017094017096, (0, 1): 0.08547008547008547, (0, 2): 0.8974358974358975}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.017094017094017096, (0, 1): 0.08547008547008547, (0, 2): 0.8974358974358975}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 105.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=111.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9459459459459459, (2, 1): 0.036036036036036036, (2, 2): 0.018018018018018018}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9459459459459459, (2, 1): 0.036036036036036036, (2, 2): 0.018018018018018018}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 105.0 -> 106.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 105.0 -> 106.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 133.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=135.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007407407407407408, (0, 1): 0.9851851851851852, (0, 2): 0.007407407407407408}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.007407407407407408, (0, 1): 0.9851851851851852, (0, 2): 0.007407407407407408}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 133.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=138.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9637681159420289, (1, 1): 0.007246376811594203, (1, 2): 0.028985507246376812}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.9637681159420289, (1, 1): 0.007246376811594203, (1, 2): 0.028985507246376812}
in decode_message(signal=1) Receiver 2 got option: (1, 2) and decoded action: 2
Receiver 2 received signals: [1] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 1): 133.0 -> 133.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 101.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=107.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9439252336448598, (1, 1): 0.018691588785046728, (1, 2): 0.037383177570093455}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9439252336448598, (1, 1): 0.018691588785046728, (1, 2): 0.037383177570093455}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 101.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=112.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.017857142857142856, (0, 1): 0.9017857142857143, (0, 2): 0.08035714285714286}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.017857142857142856, (0, 1): 0.9017857142857143, (0, 2): 0.08035714285714286}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 101.0 -> 102.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 101.0 -> 102.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 133.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=135.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007407407407407408, (0, 1): 0.9851851851851852, (0, 2): 0.007407407407407408}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.007407407407407408, (0, 1): 0.9851851851851852, (0, 2): 0.007407407407407408}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 133.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=138.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9637681159420289, (1, 1): 0.007246376811594203, (1, 2): 0.028985507246376812}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9637681159420289, (1, 1): 0.007246376811594203, (1, 2): 0.028985507246376812}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 133.0 -> 134.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 133.0 -> 134.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 106.0}
in get_filtered_urn(filter=0) --- total: total=118.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01694915254237288, (0, 1): 0.0847457627118644, (0, 2): 0.8983050847457628}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.01694915254237288, (0, 1): 0.0847457627118644, (0, 2): 0.8983050847457628}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 106.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=112.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9464285714285714, (2, 1): 0.03571428571428571, (2, 2): 0.017857142857142856}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9464285714285714, (2, 1): 0.03571428571428571, (2, 2): 0.017857142857142856}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 106.0 -> 107.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 106.0 -> 107.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 113.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=118.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9576271186440678, (2, 1): 0.03389830508474576, (2, 2): 0.00847457627118644}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9576271186440678, (2, 1): 0.03389830508474576, (2, 2): 0.00847457627118644}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 113.0}
in get_filtered_urn(filter=0) --- total: total=115.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008695652173913044, (0, 1): 0.008695652173913044, (0, 2): 0.9826086956521739}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008695652173913044, (0, 1): 0.008695652173913044, (0, 2): 0.9826086956521739}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 113.0 -> 114.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 113.0 -> 114.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 84.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=95.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09473684210526316, (2, 1): 0.8842105263157894, (2, 2): 0.021052631578947368}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.09473684210526316, (2, 1): 0.8842105263157894, (2, 2): 0.021052631578947368}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 84.0}
in get_filtered_urn(filter=1) --- total: total=96.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.10416666666666667, (1, 1): 0.020833333333333332, (1, 2): 0.875}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.10416666666666667, (1, 1): 0.020833333333333332, (1, 2): 0.875}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 84.0 -> 85.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 84.0 -> 85.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 134.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=136.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007352941176470588, (0, 1): 0.9852941176470589, (0, 2): 0.007352941176470588}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.007352941176470588, (0, 1): 0.9852941176470589, (0, 2): 0.007352941176470588}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 134.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=139.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9640287769784173, (1, 1): 0.007194244604316547, (1, 2): 0.02877697841726619}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9640287769784173, (1, 1): 0.007194244604316547, (1, 2): 0.02877697841726619}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 134.0 -> 135.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 134.0 -> 135.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 107.0}
in get_filtered_urn(filter=0) --- total: total=119.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01680672268907563, (0, 1): 0.08403361344537816, (0, 2): 0.8991596638655462}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.01680672268907563, (0, 1): 0.08403361344537816, (0, 2): 0.8991596638655462}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 107.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=113.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9469026548672567, (2, 1): 0.035398230088495575, (2, 2): 0.017699115044247787}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9469026548672567, (2, 1): 0.035398230088495575, (2, 2): 0.017699115044247787}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 107.0 -> 108.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 107.0 -> 108.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 114.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=119.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.957983193277311, (2, 1): 0.03361344537815126, (2, 2): 0.008403361344537815}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.957983193277311, (2, 1): 0.03361344537815126, (2, 2): 0.008403361344537815}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 114.0}
in get_filtered_urn(filter=0) --- total: total=116.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008620689655172414, (0, 1): 0.008620689655172414, (0, 2): 0.9827586206896551}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008620689655172414, (0, 1): 0.008620689655172414, (0, 2): 0.9827586206896551}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 114.0 -> 115.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 114.0 -> 115.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 108.0}
in get_filtered_urn(filter=0) --- total: total=120.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.016666666666666666, (0, 1): 0.08333333333333333, (0, 2): 0.9}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.016666666666666666, (0, 1): 0.08333333333333333, (0, 2): 0.9}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 85.0}
in get_filtered_urn(filter=1) --- total: total=97.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.10309278350515463, (1, 1): 0.020618556701030927, (1, 2): 0.8762886597938144}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.10309278350515463, (1, 1): 0.020618556701030927, (1, 2): 0.8762886597938144}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 85.0 -> 85.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 115.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=120.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9583333333333334, (2, 1): 0.03333333333333333, (2, 2): 0.008333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9583333333333334, (2, 1): 0.03333333333333333, (2, 2): 0.008333333333333333}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 115.0}
in get_filtered_urn(filter=0) --- total: total=117.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008547008547008548, (0, 1): 0.008547008547008548, (0, 2): 0.9829059829059829}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008547008547008548, (0, 1): 0.008547008547008548, (0, 2): 0.9829059829059829}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 115.0 -> 116.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 115.0 -> 116.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 102.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=108.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9444444444444444, (1, 1): 0.018518518518518517, (1, 2): 0.037037037037037035}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9444444444444444, (1, 1): 0.018518518518518517, (1, 2): 0.037037037037037035}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 102.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=113.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.017699115044247787, (0, 1): 0.9026548672566371, (0, 2): 0.07964601769911504}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.017699115044247787, (0, 1): 0.9026548672566371, (0, 2): 0.07964601769911504}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 102.0 -> 102.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 9.0 -> 9.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 116.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=121.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9586776859504132, (2, 1): 0.03305785123966942, (2, 2): 0.008264462809917356}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.9586776859504132, (2, 1): 0.03305785123966942, (2, 2): 0.008264462809917356}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 135.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=140.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9642857142857143, (1, 1): 0.007142857142857143, (1, 2): 0.02857142857142857}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9642857142857143, (1, 1): 0.007142857142857143, (1, 2): 0.02857142857142857}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 1): 4.0 -> 4.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 0): 135.0 -> 135.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 108.0}
in get_filtered_urn(filter=0) --- total: total=120.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.016666666666666666, (0, 1): 0.08333333333333333, (0, 2): 0.9}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.016666666666666666, (0, 1): 0.08333333333333333, (0, 2): 0.9}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 108.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=114.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9473684210526315, (2, 1): 0.03508771929824561, (2, 2): 0.017543859649122806}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9473684210526315, (2, 1): 0.03508771929824561, (2, 2): 0.017543859649122806}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 108.0 -> 109.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 108.0 -> 109.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 116.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=121.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9586776859504132, (2, 1): 0.03305785123966942, (2, 2): 0.008264462809917356}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9586776859504132, (2, 1): 0.03305785123966942, (2, 2): 0.008264462809917356}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 116.0}
in get_filtered_urn(filter=0) --- total: total=118.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00847457627118644, (0, 1): 0.00847457627118644, (0, 2): 0.9830508474576272}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00847457627118644, (0, 1): 0.00847457627118644, (0, 2): 0.9830508474576272}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 116.0 -> 117.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 116.0 -> 117.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 102.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=108.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9444444444444444, (1, 1): 0.018518518518518517, (1, 2): 0.037037037037037035}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9444444444444444, (1, 1): 0.018518518518518517, (1, 2): 0.037037037037037035}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 102.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=113.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.017699115044247787, (0, 1): 0.9026548672566371, (0, 2): 0.07964601769911504}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.017699115044247787, (0, 1): 0.9026548672566371, (0, 2): 0.07964601769911504}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 102.0 -> 103.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 102.0 -> 103.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 117.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=122.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9590163934426229, (2, 1): 0.03278688524590164, (2, 2): 0.00819672131147541}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9590163934426229, (2, 1): 0.03278688524590164, (2, 2): 0.00819672131147541}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 117.0}
in get_filtered_urn(filter=0) --- total: total=119.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008403361344537815, (0, 1): 0.008403361344537815, (0, 2): 0.9831932773109243}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008403361344537815, (0, 1): 0.008403361344537815, (0, 2): 0.9831932773109243}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 117.0 -> 118.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 117.0 -> 118.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 103.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=109.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.944954128440367, (1, 1): 0.01834862385321101, (1, 2): 0.03669724770642202}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.944954128440367, (1, 1): 0.01834862385321101, (1, 2): 0.03669724770642202}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 103.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=114.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.017543859649122806, (0, 1): 0.9035087719298246, (0, 2): 0.07894736842105263}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.017543859649122806, (0, 1): 0.9035087719298246, (0, 2): 0.07894736842105263}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 103.0 -> 104.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 103.0 -> 104.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 135.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=137.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0072992700729927005, (0, 1): 0.9854014598540146, (0, 2): 0.0072992700729927005}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0072992700729927005, (0, 1): 0.9854014598540146, (0, 2): 0.0072992700729927005}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 135.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=140.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9642857142857143, (1, 1): 0.007142857142857143, (1, 2): 0.02857142857142857}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9642857142857143, (1, 1): 0.007142857142857143, (1, 2): 0.02857142857142857}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 135.0 -> 136.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 135.0 -> 136.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 104.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=110.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9454545454545454, (1, 1): 0.01818181818181818, (1, 2): 0.03636363636363636}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9454545454545454, (1, 1): 0.01818181818181818, (1, 2): 0.03636363636363636}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 104.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=115.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.017391304347826087, (0, 1): 0.9043478260869565, (0, 2): 0.0782608695652174}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.017391304347826087, (0, 1): 0.9043478260869565, (0, 2): 0.0782608695652174}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 104.0 -> 105.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 104.0 -> 105.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 136.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=138.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007246376811594203, (0, 1): 0.9855072463768116, (0, 2): 0.007246376811594203}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.007246376811594203, (0, 1): 0.9855072463768116, (0, 2): 0.007246376811594203}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 136.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=141.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9645390070921985, (1, 1): 0.0070921985815602835, (1, 2): 0.028368794326241134}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9645390070921985, (1, 1): 0.0070921985815602835, (1, 2): 0.028368794326241134}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 136.0 -> 137.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 136.0 -> 137.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 105.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=111.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9459459459459459, (1, 1): 0.018018018018018018, (1, 2): 0.036036036036036036}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9459459459459459, (1, 1): 0.018018018018018018, (1, 2): 0.036036036036036036}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 105.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=116.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.017241379310344827, (0, 1): 0.9051724137931034, (0, 2): 0.07758620689655173}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.017241379310344827, (0, 1): 0.9051724137931034, (0, 2): 0.07758620689655173}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 105.0 -> 106.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 105.0 -> 106.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 137.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=139.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007194244604316547, (0, 1): 0.9856115107913669, (0, 2): 0.007194244604316547}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.007194244604316547, (0, 1): 0.9856115107913669, (0, 2): 0.007194244604316547}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 137.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=142.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9647887323943662, (1, 1): 0.007042253521126761, (1, 2): 0.028169014084507043}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9647887323943662, (1, 1): 0.007042253521126761, (1, 2): 0.028169014084507043}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 137.0 -> 138.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 137.0 -> 138.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 106.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=112.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9464285714285714, (1, 1): 0.017857142857142856, (1, 2): 0.03571428571428571}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9464285714285714, (1, 1): 0.017857142857142856, (1, 2): 0.03571428571428571}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 106.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=117.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.017094017094017096, (0, 1): 0.905982905982906, (0, 2): 0.07692307692307693}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.017094017094017096, (0, 1): 0.905982905982906, (0, 2): 0.07692307692307693}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 106.0 -> 107.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 106.0 -> 107.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 138.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=140.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007142857142857143, (0, 1): 0.9857142857142858, (0, 2): 0.007142857142857143}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.007142857142857143, (0, 1): 0.9857142857142858, (0, 2): 0.007142857142857143}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 138.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=143.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.965034965034965, (1, 1): 0.006993006993006993, (1, 2): 0.027972027972027972}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.965034965034965, (1, 1): 0.006993006993006993, (1, 2): 0.027972027972027972}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 138.0 -> 139.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 138.0 -> 139.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 109.0}
in get_filtered_urn(filter=0) --- total: total=121.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01652892561983471, (0, 1): 0.08264462809917356, (0, 2): 0.9008264462809917}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.01652892561983471, (0, 1): 0.08264462809917356, (0, 2): 0.9008264462809917}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 109.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=115.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9478260869565217, (2, 1): 0.034782608695652174, (2, 2): 0.017391304347826087}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9478260869565217, (2, 1): 0.034782608695652174, (2, 2): 0.017391304347826087}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 109.0 -> 110.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 109.0 -> 110.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 118.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=123.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.959349593495935, (2, 1): 0.032520325203252036, (2, 2): 0.008130081300813009}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.959349593495935, (2, 1): 0.032520325203252036, (2, 2): 0.008130081300813009}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 118.0}
in get_filtered_urn(filter=0) --- total: total=120.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008333333333333333, (0, 1): 0.008333333333333333, (0, 2): 0.9833333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008333333333333333, (0, 1): 0.008333333333333333, (0, 2): 0.9833333333333333}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 118.0 -> 119.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 118.0 -> 119.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 110.0}
in get_filtered_urn(filter=0) --- total: total=122.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01639344262295082, (0, 1): 0.08196721311475409, (0, 2): 0.9016393442622951}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.01639344262295082, (0, 1): 0.08196721311475409, (0, 2): 0.9016393442622951}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 110.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=116.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9482758620689655, (2, 1): 0.034482758620689655, (2, 2): 0.017241379310344827}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9482758620689655, (2, 1): 0.034482758620689655, (2, 2): 0.017241379310344827}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 110.0 -> 111.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 110.0 -> 111.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 139.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=141.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0070921985815602835, (0, 1): 0.9858156028368794, (0, 2): 0.0070921985815602835}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0070921985815602835, (0, 1): 0.9858156028368794, (0, 2): 0.0070921985815602835}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 139.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=144.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9652777777777778, (1, 1): 0.006944444444444444, (1, 2): 0.027777777777777776}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9652777777777778, (1, 1): 0.006944444444444444, (1, 2): 0.027777777777777776}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 139.0 -> 140.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 139.0 -> 140.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 107.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=113.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9469026548672567, (1, 1): 0.017699115044247787, (1, 2): 0.035398230088495575}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9469026548672567, (1, 1): 0.017699115044247787, (1, 2): 0.035398230088495575}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 107.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=118.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01694915254237288, (0, 1): 0.9067796610169492, (0, 2): 0.07627118644067797}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.01694915254237288, (0, 1): 0.9067796610169492, (0, 2): 0.07627118644067797}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 107.0 -> 108.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 107.0 -> 108.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 140.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=142.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007042253521126761, (0, 1): 0.9859154929577465, (0, 2): 0.007042253521126761}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.007042253521126761, (0, 1): 0.9859154929577465, (0, 2): 0.007042253521126761}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 140.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=145.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9655172413793104, (1, 1): 0.006896551724137931, (1, 2): 0.027586206896551724}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9655172413793104, (1, 1): 0.006896551724137931, (1, 2): 0.027586206896551724}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 140.0 -> 141.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 140.0 -> 141.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 85.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=96.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09375, (2, 1): 0.8854166666666666, (2, 2): 0.020833333333333332}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.09375, (2, 1): 0.8854166666666666, (2, 2): 0.020833333333333332}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 108.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=119.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01680672268907563, (0, 1): 0.907563025210084, (0, 2): 0.07563025210084033}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.01680672268907563, (0, 1): 0.907563025210084, (0, 2): 0.07563025210084033}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 9.0 -> 9.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 108.0 -> 108.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 182.0}
in get_filtered_urn(filter=1) --- total: total=184.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005434782608695652, (1, 1): 0.005434782608695652, (1, 2): 0.9891304347826086}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005434782608695652, (1, 1): 0.005434782608695652, (1, 2): 0.9891304347826086}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 182.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=184.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005434782608695652, (2, 1): 0.9891304347826086, (2, 2): 0.005434782608695652}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005434782608695652, (2, 1): 0.9891304347826086, (2, 2): 0.005434782608695652}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 182.0 -> 183.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 182.0 -> 183.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 108.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=114.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9473684210526315, (1, 1): 0.017543859649122806, (1, 2): 0.03508771929824561}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9473684210526315, (1, 1): 0.017543859649122806, (1, 2): 0.03508771929824561}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 108.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=119.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01680672268907563, (0, 1): 0.907563025210084, (0, 2): 0.07563025210084033}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.01680672268907563, (0, 1): 0.907563025210084, (0, 2): 0.07563025210084033}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 108.0 -> 109.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 108.0 -> 109.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 183.0}
in get_filtered_urn(filter=1) --- total: total=185.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005405405405405406, (1, 1): 0.005405405405405406, (1, 2): 0.9891891891891892}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005405405405405406, (1, 1): 0.005405405405405406, (1, 2): 0.9891891891891892}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 183.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=185.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005405405405405406, (2, 1): 0.9891891891891892, (2, 2): 0.005405405405405406}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005405405405405406, (2, 1): 0.9891891891891892, (2, 2): 0.005405405405405406}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 183.0 -> 184.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 183.0 -> 184.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 111.0}
in get_filtered_urn(filter=0) --- total: total=123.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.016260162601626018, (0, 1): 0.08130081300813008, (0, 2): 0.9024390243902439}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.016260162601626018, (0, 1): 0.08130081300813008, (0, 2): 0.9024390243902439}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 111.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=117.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9487179487179487, (2, 1): 0.03418803418803419, (2, 2): 0.017094017094017096}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9487179487179487, (2, 1): 0.03418803418803419, (2, 2): 0.017094017094017096}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 111.0 -> 112.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 111.0 -> 112.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 119.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=124.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9596774193548387, (2, 1): 0.03225806451612903, (2, 2): 0.008064516129032258}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9596774193548387, (2, 1): 0.03225806451612903, (2, 2): 0.008064516129032258}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 119.0}
in get_filtered_urn(filter=0) --- total: total=121.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008264462809917356, (0, 1): 0.008264462809917356, (0, 2): 0.9834710743801653}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008264462809917356, (0, 1): 0.008264462809917356, (0, 2): 0.9834710743801653}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 119.0 -> 120.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 119.0 -> 120.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 85.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=96.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09375, (2, 1): 0.8854166666666666, (2, 2): 0.020833333333333332}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.09375, (2, 1): 0.8854166666666666, (2, 2): 0.020833333333333332}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 85.0}
in get_filtered_urn(filter=1) --- total: total=97.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.10309278350515463, (1, 1): 0.020618556701030927, (1, 2): 0.8762886597938144}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.10309278350515463, (1, 1): 0.020618556701030927, (1, 2): 0.8762886597938144}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 85.0 -> 85.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 184.0}
in get_filtered_urn(filter=1) --- total: total=186.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005376344086021506, (1, 1): 0.005376344086021506, (1, 2): 0.989247311827957}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005376344086021506, (1, 1): 0.005376344086021506, (1, 2): 0.989247311827957}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 184.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=186.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005376344086021506, (2, 1): 0.989247311827957, (2, 2): 0.005376344086021506}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005376344086021506, (2, 1): 0.989247311827957, (2, 2): 0.005376344086021506}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 184.0 -> 185.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 184.0 -> 185.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 112.0}
in get_filtered_urn(filter=0) --- total: total=124.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.016129032258064516, (0, 1): 0.08064516129032258, (0, 2): 0.9032258064516129}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.016129032258064516, (0, 1): 0.08064516129032258, (0, 2): 0.9032258064516129}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 112.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=118.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9491525423728814, (2, 1): 0.03389830508474576, (2, 2): 0.01694915254237288}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9491525423728814, (2, 1): 0.03389830508474576, (2, 2): 0.01694915254237288}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 112.0 -> 113.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 112.0 -> 113.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 141.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=143.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006993006993006993, (0, 1): 0.986013986013986, (0, 2): 0.006993006993006993}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006993006993006993, (0, 1): 0.986013986013986, (0, 2): 0.006993006993006993}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 141.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=146.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9657534246575342, (1, 1): 0.00684931506849315, (1, 2): 0.0273972602739726}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9657534246575342, (1, 1): 0.00684931506849315, (1, 2): 0.0273972602739726}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 141.0 -> 142.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 141.0 -> 142.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 85.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=96.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09375, (2, 1): 0.8854166666666666, (2, 2): 0.020833333333333332}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.09375, (2, 1): 0.8854166666666666, (2, 2): 0.020833333333333332}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 85.0}
in get_filtered_urn(filter=1) --- total: total=97.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.10309278350515463, (1, 1): 0.020618556701030927, (1, 2): 0.8762886597938144}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.10309278350515463, (1, 1): 0.020618556701030927, (1, 2): 0.8762886597938144}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 85.0 -> 86.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 85.0 -> 86.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 120.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=125.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.96, (2, 1): 0.032, (2, 2): 0.008}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.96, (2, 1): 0.032, (2, 2): 0.008}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 120.0}
in get_filtered_urn(filter=0) --- total: total=122.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00819672131147541, (0, 1): 0.00819672131147541, (0, 2): 0.9836065573770492}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00819672131147541, (0, 1): 0.00819672131147541, (0, 2): 0.9836065573770492}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 120.0 -> 121.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 120.0 -> 121.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 113.0}
in get_filtered_urn(filter=0) --- total: total=125.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.016, (0, 1): 0.08, (0, 2): 0.904}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.016, (0, 1): 0.08, (0, 2): 0.904}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 113.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=119.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9495798319327731, (2, 1): 0.03361344537815126, (2, 2): 0.01680672268907563}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9495798319327731, (2, 1): 0.03361344537815126, (2, 2): 0.01680672268907563}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 113.0 -> 114.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 113.0 -> 114.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 121.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=126.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9603174603174603, (2, 1): 0.031746031746031744, (2, 2): 0.007936507936507936}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9603174603174603, (2, 1): 0.031746031746031744, (2, 2): 0.007936507936507936}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 121.0}
in get_filtered_urn(filter=0) --- total: total=123.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008130081300813009, (0, 1): 0.008130081300813009, (0, 2): 0.983739837398374}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008130081300813009, (0, 1): 0.008130081300813009, (0, 2): 0.983739837398374}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 121.0 -> 122.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 121.0 -> 122.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 114.0}
in get_filtered_urn(filter=0) --- total: total=126.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015873015873015872, (0, 1): 0.07936507936507936, (0, 2): 0.9047619047619048}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.015873015873015872, (0, 1): 0.07936507936507936, (0, 2): 0.9047619047619048}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 86.0}
in get_filtered_urn(filter=1) --- total: total=98.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.10204081632653061, (1, 1): 0.02040816326530612, (1, 2): 0.8775510204081632}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.10204081632653061, (1, 1): 0.02040816326530612, (1, 2): 0.8775510204081632}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 86.0 -> 86.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 142.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=144.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006944444444444444, (0, 1): 0.9861111111111112, (0, 2): 0.006944444444444444}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006944444444444444, (0, 1): 0.9861111111111112, (0, 2): 0.006944444444444444}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 142.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=147.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9659863945578231, (1, 1): 0.006802721088435374, (1, 2): 0.027210884353741496}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9659863945578231, (1, 1): 0.006802721088435374, (1, 2): 0.027210884353741496}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 142.0 -> 143.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 142.0 -> 143.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 86.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=97.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09278350515463918, (2, 1): 0.8865979381443299, (2, 2): 0.020618556701030927}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.09278350515463918, (2, 1): 0.8865979381443299, (2, 2): 0.020618556701030927}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 86.0}
in get_filtered_urn(filter=1) --- total: total=98.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.10204081632653061, (1, 1): 0.02040816326530612, (1, 2): 0.8775510204081632}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.10204081632653061, (1, 1): 0.02040816326530612, (1, 2): 0.8775510204081632}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 86.0 -> 87.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 86.0 -> 87.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 122.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=127.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9606299212598425, (2, 1): 0.031496062992125984, (2, 2): 0.007874015748031496}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9606299212598425, (2, 1): 0.031496062992125984, (2, 2): 0.007874015748031496}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 122.0}
in get_filtered_urn(filter=0) --- total: total=124.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008064516129032258, (0, 1): 0.008064516129032258, (0, 2): 0.9838709677419355}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008064516129032258, (0, 1): 0.008064516129032258, (0, 2): 0.9838709677419355}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 122.0 -> 123.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 122.0 -> 123.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 109.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=115.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9478260869565217, (1, 1): 0.017391304347826087, (1, 2): 0.034782608695652174}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9478260869565217, (1, 1): 0.017391304347826087, (1, 2): 0.034782608695652174}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 109.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=120.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.016666666666666666, (0, 1): 0.9083333333333333, (0, 2): 0.075}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.016666666666666666, (0, 1): 0.9083333333333333, (0, 2): 0.075}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 109.0 -> 110.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 109.0 -> 110.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 185.0}
in get_filtered_urn(filter=1) --- total: total=187.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0053475935828877, (1, 1): 0.0053475935828877, (1, 2): 0.9893048128342246}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0053475935828877, (1, 1): 0.0053475935828877, (1, 2): 0.9893048128342246}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 185.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=187.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0053475935828877, (2, 1): 0.9893048128342246, (2, 2): 0.0053475935828877}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0053475935828877, (2, 1): 0.9893048128342246, (2, 2): 0.0053475935828877}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 185.0 -> 186.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 185.0 -> 186.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 87.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=98.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09183673469387756, (2, 1): 0.8877551020408163, (2, 2): 0.02040816326530612}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.09183673469387756, (2, 1): 0.8877551020408163, (2, 2): 0.02040816326530612}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 87.0}
in get_filtered_urn(filter=1) --- total: total=99.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.10101010101010101, (1, 1): 0.020202020202020204, (1, 2): 0.8787878787878788}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.10101010101010101, (1, 1): 0.020202020202020204, (1, 2): 0.8787878787878788}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 87.0 -> 88.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 87.0 -> 88.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 143.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=145.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006896551724137931, (0, 1): 0.9862068965517241, (0, 2): 0.006896551724137931}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006896551724137931, (0, 1): 0.9862068965517241, (0, 2): 0.006896551724137931}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 143.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=148.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9662162162162162, (1, 1): 0.006756756756756757, (1, 2): 0.02702702702702703}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9662162162162162, (1, 1): 0.006756756756756757, (1, 2): 0.02702702702702703}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 143.0 -> 144.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 143.0 -> 144.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 114.0}
in get_filtered_urn(filter=0) --- total: total=126.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015873015873015872, (0, 1): 0.07936507936507936, (0, 2): 0.9047619047619048}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.015873015873015872, (0, 1): 0.07936507936507936, (0, 2): 0.9047619047619048}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 114.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=120.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.95, (2, 1): 0.03333333333333333, (2, 2): 0.016666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.95, (2, 1): 0.03333333333333333, (2, 2): 0.016666666666666666}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 114.0 -> 115.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 114.0 -> 115.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 123.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=128.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9609375, (2, 1): 0.03125, (2, 2): 0.0078125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9609375, (2, 1): 0.03125, (2, 2): 0.0078125}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 123.0}
in get_filtered_urn(filter=0) --- total: total=125.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008, (0, 1): 0.008, (0, 2): 0.984}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008, (0, 1): 0.008, (0, 2): 0.984}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 123.0 -> 124.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 123.0 -> 124.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 110.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=116.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9482758620689655, (1, 1): 0.017241379310344827, (1, 2): 0.034482758620689655}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.9482758620689655, (1, 1): 0.017241379310344827, (1, 2): 0.034482758620689655}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 115.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=121.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9504132231404959, (2, 1): 0.03305785123966942, (2, 2): 0.01652892561983471}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9504132231404959, (2, 1): 0.03305785123966942, (2, 2): 0.01652892561983471}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 115.0 -> 115.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 124.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=129.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9612403100775194, (2, 1): 0.031007751937984496, (2, 2): 0.007751937984496124}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9612403100775194, (2, 1): 0.031007751937984496, (2, 2): 0.007751937984496124}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 124.0}
in get_filtered_urn(filter=0) --- total: total=126.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007936507936507936, (0, 1): 0.007936507936507936, (0, 2): 0.9841269841269841}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.007936507936507936, (0, 1): 0.007936507936507936, (0, 2): 0.9841269841269841}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 124.0 -> 125.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 124.0 -> 125.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 110.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=116.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9482758620689655, (1, 1): 0.017241379310344827, (1, 2): 0.034482758620689655}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.9482758620689655, (1, 1): 0.017241379310344827, (1, 2): 0.034482758620689655}
Sender 4 got filter 1 choose option: (1, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 88.0}
in get_filtered_urn(filter=1) --- total: total=100.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.1, (1, 1): 0.02, (1, 2): 0.88}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.1, (1, 1): 0.02, (1, 2): 0.88}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 1): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 88.0 -> 88.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 144.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=146.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00684931506849315, (0, 1): 0.9863013698630136, (0, 2): 0.00684931506849315}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00684931506849315, (0, 1): 0.9863013698630136, (0, 2): 0.00684931506849315}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 144.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=149.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9664429530201343, (1, 1): 0.006711409395973154, (1, 2): 0.026845637583892617}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9664429530201343, (1, 1): 0.006711409395973154, (1, 2): 0.026845637583892617}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 144.0 -> 145.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 144.0 -> 145.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 110.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=116.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9482758620689655, (1, 1): 0.017241379310344827, (1, 2): 0.034482758620689655}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9482758620689655, (1, 1): 0.017241379310344827, (1, 2): 0.034482758620689655}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 110.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=121.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01652892561983471, (0, 1): 0.9090909090909091, (0, 2): 0.0743801652892562}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.01652892561983471, (0, 1): 0.9090909090909091, (0, 2): 0.0743801652892562}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 110.0 -> 111.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 110.0 -> 111.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 145.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=147.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006802721088435374, (0, 1): 0.9863945578231292, (0, 2): 0.006802721088435374}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.006802721088435374, (0, 1): 0.9863945578231292, (0, 2): 0.006802721088435374}
Sender 1 got filter 0 choose option: (0, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 125.0}
in get_filtered_urn(filter=0) --- total: total=127.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007874015748031496, (0, 1): 0.007874015748031496, (0, 2): 0.984251968503937}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.007874015748031496, (0, 1): 0.007874015748031496, (0, 2): 0.984251968503937}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 0): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 2): 125.0 -> 125.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 115.0}
in get_filtered_urn(filter=0) --- total: total=127.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015748031496062992, (0, 1): 0.07874015748031496, (0, 2): 0.905511811023622}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.015748031496062992, (0, 1): 0.07874015748031496, (0, 2): 0.905511811023622}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 88.0}
in get_filtered_urn(filter=1) --- total: total=100.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.1, (1, 1): 0.02, (1, 2): 0.88}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.1, (1, 1): 0.02, (1, 2): 0.88}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 88.0 -> 88.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 186.0}
in get_filtered_urn(filter=1) --- total: total=188.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005319148936170213, (1, 1): 0.005319148936170213, (1, 2): 0.9893617021276596}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005319148936170213, (1, 1): 0.005319148936170213, (1, 2): 0.9893617021276596}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 186.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=188.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005319148936170213, (2, 1): 0.9893617021276596, (2, 2): 0.005319148936170213}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005319148936170213, (2, 1): 0.9893617021276596, (2, 2): 0.005319148936170213}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 186.0 -> 187.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 186.0 -> 187.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 111.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=117.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9487179487179487, (1, 1): 0.017094017094017096, (1, 2): 0.03418803418803419}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9487179487179487, (1, 1): 0.017094017094017096, (1, 2): 0.03418803418803419}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 111.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=122.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01639344262295082, (0, 1): 0.9098360655737705, (0, 2): 0.07377049180327869}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.01639344262295082, (0, 1): 0.9098360655737705, (0, 2): 0.07377049180327869}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 111.0 -> 112.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 111.0 -> 112.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 145.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=147.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006802721088435374, (0, 1): 0.9863945578231292, (0, 2): 0.006802721088435374}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006802721088435374, (0, 1): 0.9863945578231292, (0, 2): 0.006802721088435374}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 145.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=150.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9666666666666667, (1, 1): 0.006666666666666667, (1, 2): 0.02666666666666667}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9666666666666667, (1, 1): 0.006666666666666667, (1, 2): 0.02666666666666667}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 145.0 -> 146.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 145.0 -> 146.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 88.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=99.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09090909090909091, (2, 1): 0.8888888888888888, (2, 2): 0.020202020202020204}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.09090909090909091, (2, 1): 0.8888888888888888, (2, 2): 0.020202020202020204}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 112.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=123.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.016260162601626018, (0, 1): 0.9105691056910569, (0, 2): 0.07317073170731707}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.016260162601626018, (0, 1): 0.9105691056910569, (0, 2): 0.07317073170731707}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 9.0 -> 9.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 112.0 -> 112.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 146.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=148.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006756756756756757, (0, 1): 0.9864864864864865, (0, 2): 0.006756756756756757}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006756756756756757, (0, 1): 0.9864864864864865, (0, 2): 0.006756756756756757}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 146.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=151.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9668874172185431, (1, 1): 0.006622516556291391, (1, 2): 0.026490066225165563}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9668874172185431, (1, 1): 0.006622516556291391, (1, 2): 0.026490066225165563}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 146.0 -> 147.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 146.0 -> 147.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 112.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=118.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9491525423728814, (1, 1): 0.01694915254237288, (1, 2): 0.03389830508474576}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9491525423728814, (1, 1): 0.01694915254237288, (1, 2): 0.03389830508474576}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 112.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=123.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.016260162601626018, (0, 1): 0.9105691056910569, (0, 2): 0.07317073170731707}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.016260162601626018, (0, 1): 0.9105691056910569, (0, 2): 0.07317073170731707}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 112.0 -> 113.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 112.0 -> 113.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 147.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=149.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006711409395973154, (0, 1): 0.9865771812080537, (0, 2): 0.006711409395973154}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006711409395973154, (0, 1): 0.9865771812080537, (0, 2): 0.006711409395973154}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 147.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=152.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9671052631578947, (1, 1): 0.006578947368421052, (1, 2): 0.02631578947368421}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9671052631578947, (1, 1): 0.006578947368421052, (1, 2): 0.02631578947368421}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 147.0 -> 148.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 147.0 -> 148.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 113.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=119.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9495798319327731, (1, 1): 0.01680672268907563, (1, 2): 0.03361344537815126}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9495798319327731, (1, 1): 0.01680672268907563, (1, 2): 0.03361344537815126}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 113.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=124.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.016129032258064516, (0, 1): 0.9112903225806451, (0, 2): 0.07258064516129033}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.016129032258064516, (0, 1): 0.9112903225806451, (0, 2): 0.07258064516129033}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 113.0 -> 114.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 113.0 -> 114.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 187.0}
in get_filtered_urn(filter=1) --- total: total=189.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005291005291005291, (1, 1): 0.005291005291005291, (1, 2): 0.9894179894179894}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005291005291005291, (1, 1): 0.005291005291005291, (1, 2): 0.9894179894179894}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 187.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=189.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005291005291005291, (2, 1): 0.9894179894179894, (2, 2): 0.005291005291005291}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005291005291005291, (2, 1): 0.9894179894179894, (2, 2): 0.005291005291005291}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 187.0 -> 188.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 187.0 -> 188.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 115.0}
in get_filtered_urn(filter=0) --- total: total=127.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015748031496062992, (0, 1): 0.07874015748031496, (0, 2): 0.905511811023622}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.015748031496062992, (0, 1): 0.07874015748031496, (0, 2): 0.905511811023622}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 115.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=121.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9504132231404959, (2, 1): 0.03305785123966942, (2, 2): 0.01652892561983471}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9504132231404959, (2, 1): 0.03305785123966942, (2, 2): 0.01652892561983471}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 115.0 -> 116.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 115.0 -> 116.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 125.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=130.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9615384615384616, (2, 1): 0.03076923076923077, (2, 2): 0.007692307692307693}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9615384615384616, (2, 1): 0.03076923076923077, (2, 2): 0.007692307692307693}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 125.0}
in get_filtered_urn(filter=0) --- total: total=127.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007874015748031496, (0, 1): 0.007874015748031496, (0, 2): 0.984251968503937}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.007874015748031496, (0, 1): 0.007874015748031496, (0, 2): 0.984251968503937}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 125.0 -> 126.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 125.0 -> 126.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 116.0}
in get_filtered_urn(filter=0) --- total: total=128.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015625, (0, 1): 0.078125, (0, 2): 0.90625}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.015625, (0, 1): 0.078125, (0, 2): 0.90625}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 116.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=122.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9508196721311475, (2, 1): 0.03278688524590164, (2, 2): 0.01639344262295082}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9508196721311475, (2, 1): 0.03278688524590164, (2, 2): 0.01639344262295082}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 116.0 -> 117.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 116.0 -> 117.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 188.0}
in get_filtered_urn(filter=1) --- total: total=190.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005263157894736842, (1, 1): 0.005263157894736842, (1, 2): 0.9894736842105263}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005263157894736842, (1, 1): 0.005263157894736842, (1, 2): 0.9894736842105263}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 188.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=190.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005263157894736842, (2, 1): 0.9894736842105263, (2, 2): 0.005263157894736842}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005263157894736842, (2, 1): 0.9894736842105263, (2, 2): 0.005263157894736842}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 188.0 -> 189.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 188.0 -> 189.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 114.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=120.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.95, (1, 1): 0.016666666666666666, (1, 2): 0.03333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.95, (1, 1): 0.016666666666666666, (1, 2): 0.03333333333333333}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 114.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=125.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.016, (0, 1): 0.912, (0, 2): 0.072}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.016, (0, 1): 0.912, (0, 2): 0.072}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 114.0 -> 115.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 114.0 -> 115.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 189.0}
in get_filtered_urn(filter=1) --- total: total=191.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005235602094240838, (1, 1): 0.005235602094240838, (1, 2): 0.9895287958115183}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005235602094240838, (1, 1): 0.005235602094240838, (1, 2): 0.9895287958115183}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 189.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=191.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005235602094240838, (2, 1): 0.9895287958115183, (2, 2): 0.005235602094240838}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005235602094240838, (2, 1): 0.9895287958115183, (2, 2): 0.005235602094240838}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 189.0 -> 190.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 189.0 -> 190.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 115.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=121.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9504132231404959, (1, 1): 0.01652892561983471, (1, 2): 0.03305785123966942}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9504132231404959, (1, 1): 0.01652892561983471, (1, 2): 0.03305785123966942}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 115.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=126.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015873015873015872, (0, 1): 0.9126984126984127, (0, 2): 0.07142857142857142}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.015873015873015872, (0, 1): 0.9126984126984127, (0, 2): 0.07142857142857142}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 115.0 -> 116.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 115.0 -> 116.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 148.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=150.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006666666666666667, (0, 1): 0.9866666666666667, (0, 2): 0.006666666666666667}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006666666666666667, (0, 1): 0.9866666666666667, (0, 2): 0.006666666666666667}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 148.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=153.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9673202614379085, (1, 1): 0.006535947712418301, (1, 2): 0.026143790849673203}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9673202614379085, (1, 1): 0.006535947712418301, (1, 2): 0.026143790849673203}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 148.0 -> 149.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 148.0 -> 149.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 88.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=99.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09090909090909091, (2, 1): 0.8888888888888888, (2, 2): 0.020202020202020204}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.09090909090909091, (2, 1): 0.8888888888888888, (2, 2): 0.020202020202020204}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 116.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=127.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015748031496062992, (0, 1): 0.9133858267716536, (0, 2): 0.07086614173228346}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.015748031496062992, (0, 1): 0.9133858267716536, (0, 2): 0.07086614173228346}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 9.0 -> 9.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 116.0 -> 116.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 190.0}
in get_filtered_urn(filter=1) --- total: total=192.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005208333333333333, (1, 1): 0.005208333333333333, (1, 2): 0.9895833333333334}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005208333333333333, (1, 1): 0.005208333333333333, (1, 2): 0.9895833333333334}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 190.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=192.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005208333333333333, (2, 1): 0.9895833333333334, (2, 2): 0.005208333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005208333333333333, (2, 1): 0.9895833333333334, (2, 2): 0.005208333333333333}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 190.0 -> 191.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 190.0 -> 191.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 88.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=99.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09090909090909091, (2, 1): 0.8888888888888888, (2, 2): 0.020202020202020204}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.09090909090909091, (2, 1): 0.8888888888888888, (2, 2): 0.020202020202020204}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 88.0}
in get_filtered_urn(filter=1) --- total: total=100.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.1, (1, 1): 0.02, (1, 2): 0.88}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.1, (1, 1): 0.02, (1, 2): 0.88}
in decode_message(signal=1) Receiver 5 got option: (1, 1) and decoded action: 1
Receiver 5 received signals: [1] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 88.0 -> 88.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 1): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 191.0}
in get_filtered_urn(filter=1) --- total: total=193.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0051813471502590676, (1, 1): 0.0051813471502590676, (1, 2): 0.9896373056994818}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0051813471502590676, (1, 1): 0.0051813471502590676, (1, 2): 0.9896373056994818}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 191.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=193.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0051813471502590676, (2, 1): 0.9896373056994818, (2, 2): 0.0051813471502590676}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0051813471502590676, (2, 1): 0.9896373056994818, (2, 2): 0.0051813471502590676}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 191.0 -> 192.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 191.0 -> 192.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 88.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=99.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09090909090909091, (2, 1): 0.8888888888888888, (2, 2): 0.020202020202020204}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.09090909090909091, (2, 1): 0.8888888888888888, (2, 2): 0.020202020202020204}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 88.0}
in get_filtered_urn(filter=1) --- total: total=100.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.1, (1, 1): 0.02, (1, 2): 0.88}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.1, (1, 1): 0.02, (1, 2): 0.88}
in decode_message(signal=1) Receiver 5 got option: (1, 1) and decoded action: 1
Receiver 5 received signals: [1] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 88.0 -> 88.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 1): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 126.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=131.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9618320610687023, (2, 1): 0.030534351145038167, (2, 2): 0.007633587786259542}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9618320610687023, (2, 1): 0.030534351145038167, (2, 2): 0.007633587786259542}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 126.0}
in get_filtered_urn(filter=0) --- total: total=128.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0078125, (0, 1): 0.0078125, (0, 2): 0.984375}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0078125, (0, 1): 0.0078125, (0, 2): 0.984375}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 126.0 -> 127.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 126.0 -> 127.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 117.0}
in get_filtered_urn(filter=0) --- total: total=129.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015503875968992248, (0, 1): 0.07751937984496124, (0, 2): 0.9069767441860465}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.015503875968992248, (0, 1): 0.07751937984496124, (0, 2): 0.9069767441860465}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 117.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=123.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9512195121951219, (2, 1): 0.032520325203252036, (2, 2): 0.016260162601626018}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9512195121951219, (2, 1): 0.032520325203252036, (2, 2): 0.016260162601626018}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 117.0 -> 118.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 117.0 -> 118.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 192.0}
in get_filtered_urn(filter=1) --- total: total=194.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005154639175257732, (1, 1): 0.005154639175257732, (1, 2): 0.9896907216494846}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005154639175257732, (1, 1): 0.005154639175257732, (1, 2): 0.9896907216494846}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 192.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=194.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005154639175257732, (2, 1): 0.9896907216494846, (2, 2): 0.005154639175257732}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005154639175257732, (2, 1): 0.9896907216494846, (2, 2): 0.005154639175257732}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 192.0 -> 193.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 192.0 -> 193.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 116.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=122.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9508196721311475, (1, 1): 0.01639344262295082, (1, 2): 0.03278688524590164}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9508196721311475, (1, 1): 0.01639344262295082, (1, 2): 0.03278688524590164}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 116.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=127.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015748031496062992, (0, 1): 0.9133858267716536, (0, 2): 0.07086614173228346}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.015748031496062992, (0, 1): 0.9133858267716536, (0, 2): 0.07086614173228346}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 116.0 -> 117.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 116.0 -> 117.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 149.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=151.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006622516556291391, (0, 1): 0.9867549668874173, (0, 2): 0.006622516556291391}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006622516556291391, (0, 1): 0.9867549668874173, (0, 2): 0.006622516556291391}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 149.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=154.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9675324675324676, (1, 1): 0.006493506493506494, (1, 2): 0.025974025974025976}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9675324675324676, (1, 1): 0.006493506493506494, (1, 2): 0.025974025974025976}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 149.0 -> 150.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 149.0 -> 150.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 117.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=123.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9512195121951219, (1, 1): 0.016260162601626018, (1, 2): 0.032520325203252036}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9512195121951219, (1, 1): 0.016260162601626018, (1, 2): 0.032520325203252036}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 117.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=128.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015625, (0, 1): 0.9140625, (0, 2): 0.0703125}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.015625, (0, 1): 0.9140625, (0, 2): 0.0703125}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 117.0 -> 118.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 117.0 -> 118.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 150.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=152.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006578947368421052, (0, 1): 0.9868421052631579, (0, 2): 0.006578947368421052}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006578947368421052, (0, 1): 0.9868421052631579, (0, 2): 0.006578947368421052}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 150.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=155.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.967741935483871, (1, 1): 0.0064516129032258064, (1, 2): 0.025806451612903226}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.967741935483871, (1, 1): 0.0064516129032258064, (1, 2): 0.025806451612903226}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 150.0 -> 151.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 150.0 -> 151.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 88.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=99.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09090909090909091, (2, 1): 0.8888888888888888, (2, 2): 0.020202020202020204}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.09090909090909091, (2, 1): 0.8888888888888888, (2, 2): 0.020202020202020204}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 88.0}
in get_filtered_urn(filter=1) --- total: total=100.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.1, (1, 1): 0.02, (1, 2): 0.88}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.1, (1, 1): 0.02, (1, 2): 0.88}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 88.0 -> 89.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 88.0 -> 89.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 151.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=153.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006535947712418301, (0, 1): 0.9869281045751634, (0, 2): 0.006535947712418301}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006535947712418301, (0, 1): 0.9869281045751634, (0, 2): 0.006535947712418301}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 151.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=156.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.967948717948718, (1, 1): 0.00641025641025641, (1, 2): 0.02564102564102564}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.967948717948718, (1, 1): 0.00641025641025641, (1, 2): 0.02564102564102564}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 151.0 -> 152.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 151.0 -> 152.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 89.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=100.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.09, (2, 1): 0.89, (2, 2): 0.02}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.09, (2, 1): 0.89, (2, 2): 0.02}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 89.0}
in get_filtered_urn(filter=1) --- total: total=101.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.09900990099009901, (1, 1): 0.019801980198019802, (1, 2): 0.8811881188118812}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.09900990099009901, (1, 1): 0.019801980198019802, (1, 2): 0.8811881188118812}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 89.0 -> 90.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 89.0 -> 90.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 193.0}
in get_filtered_urn(filter=1) --- total: total=195.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005128205128205128, (1, 1): 0.005128205128205128, (1, 2): 0.9897435897435898}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005128205128205128, (1, 1): 0.005128205128205128, (1, 2): 0.9897435897435898}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 193.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=195.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005128205128205128, (2, 1): 0.9897435897435898, (2, 2): 0.005128205128205128}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005128205128205128, (2, 1): 0.9897435897435898, (2, 2): 0.005128205128205128}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 193.0 -> 194.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 193.0 -> 194.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 118.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=124.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9516129032258065, (1, 1): 0.016129032258064516, (1, 2): 0.03225806451612903}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9516129032258065, (1, 1): 0.016129032258064516, (1, 2): 0.03225806451612903}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 118.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=129.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015503875968992248, (0, 1): 0.9147286821705426, (0, 2): 0.06976744186046512}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.015503875968992248, (0, 1): 0.9147286821705426, (0, 2): 0.06976744186046512}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 118.0 -> 119.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 118.0 -> 119.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 152.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=154.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006493506493506494, (0, 1): 0.987012987012987, (0, 2): 0.006493506493506494}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006493506493506494, (0, 1): 0.987012987012987, (0, 2): 0.006493506493506494}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 152.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=157.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9681528662420382, (1, 1): 0.006369426751592357, (1, 2): 0.025477707006369428}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9681528662420382, (1, 1): 0.006369426751592357, (1, 2): 0.025477707006369428}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 152.0 -> 153.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 152.0 -> 153.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 90.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=101.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0891089108910891, (2, 1): 0.8910891089108911, (2, 2): 0.019801980198019802}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0891089108910891, (2, 1): 0.8910891089108911, (2, 2): 0.019801980198019802}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 90.0}
in get_filtered_urn(filter=1) --- total: total=102.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.09803921568627451, (1, 1): 0.0196078431372549, (1, 2): 0.8823529411764706}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.09803921568627451, (1, 1): 0.0196078431372549, (1, 2): 0.8823529411764706}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 90.0 -> 91.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 90.0 -> 91.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 127.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=132.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9621212121212122, (2, 1): 0.030303030303030304, (2, 2): 0.007575757575757576}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9621212121212122, (2, 1): 0.030303030303030304, (2, 2): 0.007575757575757576}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 127.0}
in get_filtered_urn(filter=0) --- total: total=129.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007751937984496124, (0, 1): 0.007751937984496124, (0, 2): 0.9844961240310077}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.007751937984496124, (0, 1): 0.007751937984496124, (0, 2): 0.9844961240310077}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 127.0 -> 128.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 127.0 -> 128.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 119.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=125.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.952, (1, 1): 0.016, (1, 2): 0.032}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.952, (1, 1): 0.016, (1, 2): 0.032}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 119.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=130.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015384615384615385, (0, 1): 0.9153846153846154, (0, 2): 0.06923076923076923}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.015384615384615385, (0, 1): 0.9153846153846154, (0, 2): 0.06923076923076923}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 119.0 -> 120.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 119.0 -> 120.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 128.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=133.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9624060150375939, (2, 1): 0.03007518796992481, (2, 2): 0.007518796992481203}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9624060150375939, (2, 1): 0.03007518796992481, (2, 2): 0.007518796992481203}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 128.0}
in get_filtered_urn(filter=0) --- total: total=130.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007692307692307693, (0, 1): 0.007692307692307693, (0, 2): 0.9846153846153847}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.007692307692307693, (0, 1): 0.007692307692307693, (0, 2): 0.9846153846153847}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 128.0 -> 129.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 128.0 -> 129.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 118.0}
in get_filtered_urn(filter=0) --- total: total=130.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015384615384615385, (0, 1): 0.07692307692307693, (0, 2): 0.9076923076923077}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.015384615384615385, (0, 1): 0.07692307692307693, (0, 2): 0.9076923076923077}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 118.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=124.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9516129032258065, (2, 1): 0.03225806451612903, (2, 2): 0.016129032258064516}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9516129032258065, (2, 1): 0.03225806451612903, (2, 2): 0.016129032258064516}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 118.0 -> 119.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 118.0 -> 119.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 129.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=134.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9626865671641791, (2, 1): 0.029850746268656716, (2, 2): 0.007462686567164179}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9626865671641791, (2, 1): 0.029850746268656716, (2, 2): 0.007462686567164179}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 129.0}
in get_filtered_urn(filter=0) --- total: total=131.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007633587786259542, (0, 1): 0.007633587786259542, (0, 2): 0.9847328244274809}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.007633587786259542, (0, 1): 0.007633587786259542, (0, 2): 0.9847328244274809}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 129.0 -> 130.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 129.0 -> 130.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 120.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=126.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9523809523809523, (1, 1): 0.015873015873015872, (1, 2): 0.031746031746031744}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9523809523809523, (1, 1): 0.015873015873015872, (1, 2): 0.031746031746031744}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 120.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=131.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015267175572519083, (0, 1): 0.916030534351145, (0, 2): 0.06870229007633588}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.015267175572519083, (0, 1): 0.916030534351145, (0, 2): 0.06870229007633588}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 120.0 -> 121.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 120.0 -> 121.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 194.0}
in get_filtered_urn(filter=1) --- total: total=196.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.00510204081632653, (1, 1): 0.00510204081632653, (1, 2): 0.9897959183673469}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.00510204081632653, (1, 1): 0.00510204081632653, (1, 2): 0.9897959183673469}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 194.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=196.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.00510204081632653, (2, 1): 0.9897959183673469, (2, 2): 0.00510204081632653}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.00510204081632653, (2, 1): 0.9897959183673469, (2, 2): 0.00510204081632653}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 194.0 -> 195.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 194.0 -> 195.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 119.0}
in get_filtered_urn(filter=0) --- total: total=131.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015267175572519083, (0, 1): 0.07633587786259542, (0, 2): 0.9083969465648855}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.015267175572519083, (0, 1): 0.07633587786259542, (0, 2): 0.9083969465648855}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 119.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=125.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.952, (2, 1): 0.032, (2, 2): 0.016}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.952, (2, 1): 0.032, (2, 2): 0.016}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 119.0 -> 120.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 119.0 -> 120.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 195.0}
in get_filtered_urn(filter=1) --- total: total=197.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005076142131979695, (1, 1): 0.005076142131979695, (1, 2): 0.9898477157360406}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005076142131979695, (1, 1): 0.005076142131979695, (1, 2): 0.9898477157360406}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 195.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=197.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005076142131979695, (2, 1): 0.9898477157360406, (2, 2): 0.005076142131979695}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005076142131979695, (2, 1): 0.9898477157360406, (2, 2): 0.005076142131979695}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 195.0 -> 196.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 195.0 -> 196.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 121.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=127.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.952755905511811, (1, 1): 0.015748031496062992, (1, 2): 0.031496062992125984}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.952755905511811, (1, 1): 0.015748031496062992, (1, 2): 0.031496062992125984}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 121.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=132.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015151515151515152, (0, 1): 0.9166666666666666, (0, 2): 0.06818181818181818}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.015151515151515152, (0, 1): 0.9166666666666666, (0, 2): 0.06818181818181818}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 121.0 -> 122.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 121.0 -> 122.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 196.0}
in get_filtered_urn(filter=1) --- total: total=198.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005050505050505051, (1, 1): 0.005050505050505051, (1, 2): 0.98989898989899}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005050505050505051, (1, 1): 0.005050505050505051, (1, 2): 0.98989898989899}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 196.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=198.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005050505050505051, (2, 1): 0.98989898989899, (2, 2): 0.005050505050505051}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005050505050505051, (2, 1): 0.98989898989899, (2, 2): 0.005050505050505051}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 196.0 -> 197.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 196.0 -> 197.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 120.0}
in get_filtered_urn(filter=0) --- total: total=132.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015151515151515152, (0, 1): 0.07575757575757576, (0, 2): 0.9090909090909091}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.015151515151515152, (0, 1): 0.07575757575757576, (0, 2): 0.9090909090909091}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 120.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=126.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9523809523809523, (2, 1): 0.031746031746031744, (2, 2): 0.015873015873015872}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9523809523809523, (2, 1): 0.031746031746031744, (2, 2): 0.015873015873015872}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 120.0 -> 121.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 120.0 -> 121.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 130.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=135.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9629629629629629, (2, 1): 0.02962962962962963, (2, 2): 0.007407407407407408}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9629629629629629, (2, 1): 0.02962962962962963, (2, 2): 0.007407407407407408}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 130.0}
in get_filtered_urn(filter=0) --- total: total=132.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007575757575757576, (0, 1): 0.007575757575757576, (0, 2): 0.9848484848484849}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.007575757575757576, (0, 1): 0.007575757575757576, (0, 2): 0.9848484848484849}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 130.0 -> 131.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 130.0 -> 131.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 121.0}
in get_filtered_urn(filter=0) --- total: total=133.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015037593984962405, (0, 1): 0.07518796992481203, (0, 2): 0.9097744360902256}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.015037593984962405, (0, 1): 0.07518796992481203, (0, 2): 0.9097744360902256}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 121.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=127.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.952755905511811, (2, 1): 0.031496062992125984, (2, 2): 0.015748031496062992}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.952755905511811, (2, 1): 0.031496062992125984, (2, 2): 0.015748031496062992}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 121.0 -> 122.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 121.0 -> 122.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 131.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=136.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9632352941176471, (2, 1): 0.029411764705882353, (2, 2): 0.007352941176470588}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9632352941176471, (2, 1): 0.029411764705882353, (2, 2): 0.007352941176470588}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 131.0}
in get_filtered_urn(filter=0) --- total: total=133.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007518796992481203, (0, 1): 0.007518796992481203, (0, 2): 0.9849624060150376}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.007518796992481203, (0, 1): 0.007518796992481203, (0, 2): 0.9849624060150376}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 131.0 -> 132.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 131.0 -> 132.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 91.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=102.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.08823529411764706, (2, 1): 0.8921568627450981, (2, 2): 0.0196078431372549}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.08823529411764706, (2, 1): 0.8921568627450981, (2, 2): 0.0196078431372549}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 91.0}
in get_filtered_urn(filter=1) --- total: total=103.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0970873786407767, (1, 1): 0.019417475728155338, (1, 2): 0.883495145631068}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0970873786407767, (1, 1): 0.019417475728155338, (1, 2): 0.883495145631068}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 91.0 -> 92.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 91.0 -> 92.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 197.0}
in get_filtered_urn(filter=1) --- total: total=199.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005025125628140704, (1, 1): 0.005025125628140704, (1, 2): 0.9899497487437185}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005025125628140704, (1, 1): 0.005025125628140704, (1, 2): 0.9899497487437185}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 197.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=199.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005025125628140704, (2, 1): 0.9899497487437185, (2, 2): 0.005025125628140704}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005025125628140704, (2, 1): 0.9899497487437185, (2, 2): 0.005025125628140704}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 197.0 -> 198.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 197.0 -> 198.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 122.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=128.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.953125, (1, 1): 0.015625, (1, 2): 0.03125}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.953125, (1, 1): 0.015625, (1, 2): 0.03125}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 122.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=133.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.015037593984962405, (0, 1): 0.9172932330827067, (0, 2): 0.06766917293233082}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.015037593984962405, (0, 1): 0.9172932330827067, (0, 2): 0.06766917293233082}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 122.0 -> 123.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 122.0 -> 123.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 132.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=137.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9635036496350365, (2, 1): 0.029197080291970802, (2, 2): 0.0072992700729927005}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9635036496350365, (2, 1): 0.029197080291970802, (2, 2): 0.0072992700729927005}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 132.0}
in get_filtered_urn(filter=0) --- total: total=134.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007462686567164179, (0, 1): 0.007462686567164179, (0, 2): 0.9850746268656716}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.007462686567164179, (0, 1): 0.007462686567164179, (0, 2): 0.9850746268656716}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 132.0 -> 133.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 132.0 -> 133.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 122.0}
in get_filtered_urn(filter=0) --- total: total=134.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014925373134328358, (0, 1): 0.07462686567164178, (0, 2): 0.9104477611940298}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.014925373134328358, (0, 1): 0.07462686567164178, (0, 2): 0.9104477611940298}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 122.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=128.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.953125, (2, 1): 0.03125, (2, 2): 0.015625}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.953125, (2, 1): 0.03125, (2, 2): 0.015625}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 122.0 -> 123.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 122.0 -> 123.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 133.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=138.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9637681159420289, (2, 1): 0.028985507246376812, (2, 2): 0.007246376811594203}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9637681159420289, (2, 1): 0.028985507246376812, (2, 2): 0.007246376811594203}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 133.0}
in get_filtered_urn(filter=0) --- total: total=135.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007407407407407408, (0, 1): 0.007407407407407408, (0, 2): 0.9851851851851852}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.007407407407407408, (0, 1): 0.007407407407407408, (0, 2): 0.9851851851851852}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 133.0 -> 134.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 133.0 -> 134.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 123.0}
in get_filtered_urn(filter=0) --- total: total=135.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014814814814814815, (0, 1): 0.07407407407407407, (0, 2): 0.9111111111111111}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.014814814814814815, (0, 1): 0.07407407407407407, (0, 2): 0.9111111111111111}
Sender 4 got filter 0 choose option: (0, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 123.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=134.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014925373134328358, (0, 1): 0.917910447761194, (0, 2): 0.06716417910447761}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.014925373134328358, (0, 1): 0.917910447761194, (0, 2): 0.06716417910447761}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 0): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 123.0 -> 123.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 153.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=155.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0064516129032258064, (0, 1): 0.9870967741935484, (0, 2): 0.0064516129032258064}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0064516129032258064, (0, 1): 0.9870967741935484, (0, 2): 0.0064516129032258064}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 153.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=158.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9683544303797469, (1, 1): 0.006329113924050633, (1, 2): 0.02531645569620253}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.9683544303797469, (1, 1): 0.006329113924050633, (1, 2): 0.02531645569620253}
in decode_message(signal=1) Receiver 2 got option: (1, 1) and decoded action: 1
Receiver 2 received signals: [1] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 1): 153.0 -> 153.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 1): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 123.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=129.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9534883720930233, (1, 1): 0.015503875968992248, (1, 2): 0.031007751937984496}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9534883720930233, (1, 1): 0.015503875968992248, (1, 2): 0.031007751937984496}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 123.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=134.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014925373134328358, (0, 1): 0.917910447761194, (0, 2): 0.06716417910447761}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.014925373134328358, (0, 1): 0.917910447761194, (0, 2): 0.06716417910447761}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 123.0 -> 124.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 123.0 -> 124.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 198.0}
in get_filtered_urn(filter=1) --- total: total=200.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.005, (1, 1): 0.005, (1, 2): 0.99}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.005, (1, 1): 0.005, (1, 2): 0.99}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 198.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=200.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.005, (2, 1): 0.99, (2, 2): 0.005}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.005, (2, 1): 0.99, (2, 2): 0.005}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 198.0 -> 199.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 198.0 -> 199.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 92.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=103.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.08737864077669903, (2, 1): 0.8932038834951457, (2, 2): 0.019417475728155338}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.08737864077669903, (2, 1): 0.8932038834951457, (2, 2): 0.019417475728155338}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 92.0}
in get_filtered_urn(filter=1) --- total: total=104.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.09615384615384616, (1, 1): 0.019230769230769232, (1, 2): 0.8846153846153846}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.09615384615384616, (1, 1): 0.019230769230769232, (1, 2): 0.8846153846153846}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 92.0 -> 93.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 92.0 -> 93.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 153.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=155.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0064516129032258064, (0, 1): 0.9870967741935484, (0, 2): 0.0064516129032258064}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0064516129032258064, (0, 1): 0.9870967741935484, (0, 2): 0.0064516129032258064}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 153.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=158.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9683544303797469, (1, 1): 0.006329113924050633, (1, 2): 0.02531645569620253}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9683544303797469, (1, 1): 0.006329113924050633, (1, 2): 0.02531645569620253}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 153.0 -> 154.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 153.0 -> 154.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 124.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=130.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9538461538461539, (1, 1): 0.015384615384615385, (1, 2): 0.03076923076923077}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9538461538461539, (1, 1): 0.015384615384615385, (1, 2): 0.03076923076923077}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 124.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=135.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014814814814814815, (0, 1): 0.9185185185185185, (0, 2): 0.06666666666666667}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.014814814814814815, (0, 1): 0.9185185185185185, (0, 2): 0.06666666666666667}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 124.0 -> 125.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 124.0 -> 125.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 134.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=139.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9640287769784173, (2, 1): 0.02877697841726619, (2, 2): 0.007194244604316547}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9640287769784173, (2, 1): 0.02877697841726619, (2, 2): 0.007194244604316547}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 134.0}
in get_filtered_urn(filter=0) --- total: total=136.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007352941176470588, (0, 1): 0.007352941176470588, (0, 2): 0.9852941176470589}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.007352941176470588, (0, 1): 0.007352941176470588, (0, 2): 0.9852941176470589}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 134.0 -> 135.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 134.0 -> 135.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 125.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=131.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9541984732824428, (1, 1): 0.015267175572519083, (1, 2): 0.030534351145038167}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9541984732824428, (1, 1): 0.015267175572519083, (1, 2): 0.030534351145038167}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 125.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=136.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014705882352941176, (0, 1): 0.9191176470588235, (0, 2): 0.0661764705882353}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.014705882352941176, (0, 1): 0.9191176470588235, (0, 2): 0.0661764705882353}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 125.0 -> 126.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 125.0 -> 126.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 199.0}
in get_filtered_urn(filter=1) --- total: total=201.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004975124378109453, (1, 1): 0.004975124378109453, (1, 2): 0.9900497512437811}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004975124378109453, (1, 1): 0.004975124378109453, (1, 2): 0.9900497512437811}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 199.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=201.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004975124378109453, (2, 1): 0.9900497512437811, (2, 2): 0.004975124378109453}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004975124378109453, (2, 1): 0.9900497512437811, (2, 2): 0.004975124378109453}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 199.0 -> 200.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 199.0 -> 200.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 93.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=104.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.08653846153846154, (2, 1): 0.8942307692307693, (2, 2): 0.019230769230769232}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.08653846153846154, (2, 1): 0.8942307692307693, (2, 2): 0.019230769230769232}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 93.0}
in get_filtered_urn(filter=1) --- total: total=105.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.09523809523809523, (1, 1): 0.01904761904761905, (1, 2): 0.8857142857142857}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.09523809523809523, (1, 1): 0.01904761904761905, (1, 2): 0.8857142857142857}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 93.0 -> 94.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 93.0 -> 94.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 200.0}
in get_filtered_urn(filter=1) --- total: total=202.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0049504950495049506, (1, 1): 0.0049504950495049506, (1, 2): 0.9900990099009901}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0049504950495049506, (1, 1): 0.0049504950495049506, (1, 2): 0.9900990099009901}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 200.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=202.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0049504950495049506, (2, 1): 0.9900990099009901, (2, 2): 0.0049504950495049506}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0049504950495049506, (2, 1): 0.9900990099009901, (2, 2): 0.0049504950495049506}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 200.0 -> 201.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 200.0 -> 201.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 126.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=132.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9545454545454546, (1, 1): 0.015151515151515152, (1, 2): 0.030303030303030304}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9545454545454546, (1, 1): 0.015151515151515152, (1, 2): 0.030303030303030304}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 126.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=137.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014598540145985401, (0, 1): 0.9197080291970803, (0, 2): 0.06569343065693431}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.014598540145985401, (0, 1): 0.9197080291970803, (0, 2): 0.06569343065693431}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 126.0 -> 127.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 126.0 -> 127.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 135.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=140.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9642857142857143, (2, 1): 0.02857142857142857, (2, 2): 0.007142857142857143}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9642857142857143, (2, 1): 0.02857142857142857, (2, 2): 0.007142857142857143}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 135.0}
in get_filtered_urn(filter=0) --- total: total=137.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0072992700729927005, (0, 1): 0.0072992700729927005, (0, 2): 0.9854014598540146}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0072992700729927005, (0, 1): 0.0072992700729927005, (0, 2): 0.9854014598540146}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 135.0 -> 136.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 135.0 -> 136.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 94.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=105.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.08571428571428572, (2, 1): 0.8952380952380953, (2, 2): 0.01904761904761905}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.08571428571428572, (2, 1): 0.8952380952380953, (2, 2): 0.01904761904761905}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 94.0}
in get_filtered_urn(filter=1) --- total: total=106.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.09433962264150944, (1, 1): 0.018867924528301886, (1, 2): 0.8867924528301887}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.09433962264150944, (1, 1): 0.018867924528301886, (1, 2): 0.8867924528301887}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 94.0 -> 95.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 94.0 -> 95.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 201.0}
in get_filtered_urn(filter=1) --- total: total=203.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0049261083743842365, (1, 1): 0.0049261083743842365, (1, 2): 0.9901477832512315}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0049261083743842365, (1, 1): 0.0049261083743842365, (1, 2): 0.9901477832512315}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 201.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=203.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0049261083743842365, (2, 1): 0.9901477832512315, (2, 2): 0.0049261083743842365}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0049261083743842365, (2, 1): 0.9901477832512315, (2, 2): 0.0049261083743842365}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 201.0 -> 202.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 201.0 -> 202.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 127.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=133.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9548872180451128, (1, 1): 0.015037593984962405, (1, 2): 0.03007518796992481}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9548872180451128, (1, 1): 0.015037593984962405, (1, 2): 0.03007518796992481}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 127.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=138.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014492753623188406, (0, 1): 0.9202898550724637, (0, 2): 0.06521739130434782}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.014492753623188406, (0, 1): 0.9202898550724637, (0, 2): 0.06521739130434782}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 127.0 -> 128.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 127.0 -> 128.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 136.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=141.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9645390070921985, (2, 1): 0.028368794326241134, (2, 2): 0.0070921985815602835}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9645390070921985, (2, 1): 0.028368794326241134, (2, 2): 0.0070921985815602835}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 136.0}
in get_filtered_urn(filter=0) --- total: total=138.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007246376811594203, (0, 1): 0.007246376811594203, (0, 2): 0.9855072463768116}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.007246376811594203, (0, 1): 0.007246376811594203, (0, 2): 0.9855072463768116}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 136.0 -> 137.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 136.0 -> 137.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 123.0}
in get_filtered_urn(filter=0) --- total: total=135.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014814814814814815, (0, 1): 0.07407407407407407, (0, 2): 0.9111111111111111}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.014814814814814815, (0, 1): 0.07407407407407407, (0, 2): 0.9111111111111111}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 123.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=129.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9534883720930233, (2, 1): 0.031007751937984496, (2, 2): 0.015503875968992248}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9534883720930233, (2, 1): 0.031007751937984496, (2, 2): 0.015503875968992248}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 123.0 -> 124.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 123.0 -> 124.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 154.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=156.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00641025641025641, (0, 1): 0.9871794871794872, (0, 2): 0.00641025641025641}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00641025641025641, (0, 1): 0.9871794871794872, (0, 2): 0.00641025641025641}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 154.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=159.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9685534591194969, (1, 1): 0.006289308176100629, (1, 2): 0.025157232704402517}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9685534591194969, (1, 1): 0.006289308176100629, (1, 2): 0.025157232704402517}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 154.0 -> 155.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 154.0 -> 155.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 128.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=134.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9552238805970149, (1, 1): 0.014925373134328358, (1, 2): 0.029850746268656716}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9552238805970149, (1, 1): 0.014925373134328358, (1, 2): 0.029850746268656716}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 128.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=139.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014388489208633094, (0, 1): 0.920863309352518, (0, 2): 0.06474820143884892}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.014388489208633094, (0, 1): 0.920863309352518, (0, 2): 0.06474820143884892}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 128.0 -> 129.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 128.0 -> 129.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 202.0}
in get_filtered_urn(filter=1) --- total: total=204.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004901960784313725, (1, 1): 0.004901960784313725, (1, 2): 0.9901960784313726}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004901960784313725, (1, 1): 0.004901960784313725, (1, 2): 0.9901960784313726}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 202.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=204.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004901960784313725, (2, 1): 0.9901960784313726, (2, 2): 0.004901960784313725}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004901960784313725, (2, 1): 0.9901960784313726, (2, 2): 0.004901960784313725}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 202.0 -> 203.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 202.0 -> 203.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 95.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=106.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.08490566037735849, (2, 1): 0.8962264150943396, (2, 2): 0.018867924528301886}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.08490566037735849, (2, 1): 0.8962264150943396, (2, 2): 0.018867924528301886}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 129.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=140.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014285714285714285, (0, 1): 0.9214285714285714, (0, 2): 0.06428571428571428}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.014285714285714285, (0, 1): 0.9214285714285714, (0, 2): 0.06428571428571428}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 9.0 -> 9.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 129.0 -> 129.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 155.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=157.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006369426751592357, (0, 1): 0.9872611464968153, (0, 2): 0.006369426751592357}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006369426751592357, (0, 1): 0.9872611464968153, (0, 2): 0.006369426751592357}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 155.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=160.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.96875, (1, 1): 0.00625, (1, 2): 0.025}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.96875, (1, 1): 0.00625, (1, 2): 0.025}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 155.0 -> 156.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 155.0 -> 156.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 95.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=106.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.08490566037735849, (2, 1): 0.8962264150943396, (2, 2): 0.018867924528301886}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.08490566037735849, (2, 1): 0.8962264150943396, (2, 2): 0.018867924528301886}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 95.0}
in get_filtered_urn(filter=1) --- total: total=107.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.09345794392523364, (1, 1): 0.018691588785046728, (1, 2): 0.8878504672897196}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.09345794392523364, (1, 1): 0.018691588785046728, (1, 2): 0.8878504672897196}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 95.0 -> 96.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 95.0 -> 96.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 156.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=158.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006329113924050633, (0, 1): 0.9873417721518988, (0, 2): 0.006329113924050633}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006329113924050633, (0, 1): 0.9873417721518988, (0, 2): 0.006329113924050633}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 156.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=161.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.968944099378882, (1, 1): 0.006211180124223602, (1, 2): 0.024844720496894408}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.968944099378882, (1, 1): 0.006211180124223602, (1, 2): 0.024844720496894408}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 156.0 -> 157.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 156.0 -> 157.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 96.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=107.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.08411214953271028, (2, 1): 0.897196261682243, (2, 2): 0.018691588785046728}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.08411214953271028, (2, 1): 0.897196261682243, (2, 2): 0.018691588785046728}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 96.0}
in get_filtered_urn(filter=1) --- total: total=108.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.09259259259259259, (1, 1): 0.018518518518518517, (1, 2): 0.8888888888888888}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.09259259259259259, (1, 1): 0.018518518518518517, (1, 2): 0.8888888888888888}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 96.0 -> 97.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 96.0 -> 97.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 137.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=142.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9647887323943662, (2, 1): 0.028169014084507043, (2, 2): 0.007042253521126761}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9647887323943662, (2, 1): 0.028169014084507043, (2, 2): 0.007042253521126761}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 137.0}
in get_filtered_urn(filter=0) --- total: total=139.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007194244604316547, (0, 1): 0.007194244604316547, (0, 2): 0.9856115107913669}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.007194244604316547, (0, 1): 0.007194244604316547, (0, 2): 0.9856115107913669}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 137.0 -> 138.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 137.0 -> 138.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 97.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=108.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.08333333333333333, (2, 1): 0.8981481481481481, (2, 2): 0.018518518518518517}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.08333333333333333, (2, 1): 0.8981481481481481, (2, 2): 0.018518518518518517}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 97.0}
in get_filtered_urn(filter=1) --- total: total=109.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.09174311926605505, (1, 1): 0.01834862385321101, (1, 2): 0.8899082568807339}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.09174311926605505, (1, 1): 0.01834862385321101, (1, 2): 0.8899082568807339}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 97.0 -> 98.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 97.0 -> 98.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 203.0}
in get_filtered_urn(filter=1) --- total: total=205.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004878048780487805, (1, 1): 0.004878048780487805, (1, 2): 0.9902439024390244}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004878048780487805, (1, 1): 0.004878048780487805, (1, 2): 0.9902439024390244}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 203.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=205.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004878048780487805, (2, 1): 0.9902439024390244, (2, 2): 0.004878048780487805}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004878048780487805, (2, 1): 0.9902439024390244, (2, 2): 0.004878048780487805}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 203.0 -> 204.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 203.0 -> 204.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 124.0}
in get_filtered_urn(filter=0) --- total: total=136.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014705882352941176, (0, 1): 0.07352941176470588, (0, 2): 0.9117647058823529}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.014705882352941176, (0, 1): 0.07352941176470588, (0, 2): 0.9117647058823529}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 124.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=130.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9538461538461539, (2, 1): 0.03076923076923077, (2, 2): 0.015384615384615385}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9538461538461539, (2, 1): 0.03076923076923077, (2, 2): 0.015384615384615385}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 124.0 -> 125.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 124.0 -> 125.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 157.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=159.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006289308176100629, (0, 1): 0.9874213836477987, (0, 2): 0.006289308176100629}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006289308176100629, (0, 1): 0.9874213836477987, (0, 2): 0.006289308176100629}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 157.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=162.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9691358024691358, (1, 1): 0.006172839506172839, (1, 2): 0.024691358024691357}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9691358024691358, (1, 1): 0.006172839506172839, (1, 2): 0.024691358024691357}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 157.0 -> 158.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 157.0 -> 158.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 125.0}
in get_filtered_urn(filter=0) --- total: total=137.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014598540145985401, (0, 1): 0.072992700729927, (0, 2): 0.9124087591240876}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.014598540145985401, (0, 1): 0.072992700729927, (0, 2): 0.9124087591240876}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 125.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=131.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9541984732824428, (2, 1): 0.030534351145038167, (2, 2): 0.015267175572519083}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9541984732824428, (2, 1): 0.030534351145038167, (2, 2): 0.015267175572519083}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 125.0 -> 126.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 125.0 -> 126.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 158.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=160.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00625, (0, 1): 0.9875, (0, 2): 0.00625}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00625, (0, 1): 0.9875, (0, 2): 0.00625}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 158.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=163.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9693251533742331, (1, 1): 0.006134969325153374, (1, 2): 0.024539877300613498}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9693251533742331, (1, 1): 0.006134969325153374, (1, 2): 0.024539877300613498}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 158.0 -> 159.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 158.0 -> 159.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 98.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=109.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.08256880733944955, (2, 1): 0.8990825688073395, (2, 2): 0.01834862385321101}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.08256880733944955, (2, 1): 0.8990825688073395, (2, 2): 0.01834862385321101}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 98.0}
in get_filtered_urn(filter=1) --- total: total=110.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.09090909090909091, (1, 1): 0.01818181818181818, (1, 2): 0.8909090909090909}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.09090909090909091, (1, 1): 0.01818181818181818, (1, 2): 0.8909090909090909}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 98.0 -> 99.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 98.0 -> 99.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 138.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=143.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.965034965034965, (2, 1): 0.027972027972027972, (2, 2): 0.006993006993006993}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.965034965034965, (2, 1): 0.027972027972027972, (2, 2): 0.006993006993006993}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 138.0}
in get_filtered_urn(filter=0) --- total: total=140.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007142857142857143, (0, 1): 0.007142857142857143, (0, 2): 0.9857142857142858}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.007142857142857143, (0, 1): 0.007142857142857143, (0, 2): 0.9857142857142858}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 138.0 -> 139.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 138.0 -> 139.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 99.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=110.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.08181818181818182, (2, 1): 0.9, (2, 2): 0.01818181818181818}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.08181818181818182, (2, 1): 0.9, (2, 2): 0.01818181818181818}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 99.0}
in get_filtered_urn(filter=1) --- total: total=111.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.09009009009009009, (1, 1): 0.018018018018018018, (1, 2): 0.8918918918918919}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.09009009009009009, (1, 1): 0.018018018018018018, (1, 2): 0.8918918918918919}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 99.0 -> 100.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 99.0 -> 100.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 159.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=161.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006211180124223602, (0, 1): 0.9875776397515528, (0, 2): 0.006211180124223602}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006211180124223602, (0, 1): 0.9875776397515528, (0, 2): 0.006211180124223602}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 159.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=164.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9695121951219512, (1, 1): 0.006097560975609756, (1, 2): 0.024390243902439025}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9695121951219512, (1, 1): 0.006097560975609756, (1, 2): 0.024390243902439025}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 159.0 -> 160.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 159.0 -> 160.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 100.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=111.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.08108108108108109, (2, 1): 0.9009009009009009, (2, 2): 0.018018018018018018}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.08108108108108109, (2, 1): 0.9009009009009009, (2, 2): 0.018018018018018018}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 126.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=132.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9545454545454546, (2, 1): 0.030303030303030304, (2, 2): 0.015151515151515152}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9545454545454546, (2, 1): 0.030303030303030304, (2, 2): 0.015151515151515152}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 126.0 -> 126.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 160.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=162.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006172839506172839, (0, 1): 0.9876543209876543, (0, 2): 0.006172839506172839}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006172839506172839, (0, 1): 0.9876543209876543, (0, 2): 0.006172839506172839}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 160.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=165.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9696969696969697, (1, 1): 0.006060606060606061, (1, 2): 0.024242424242424242}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9696969696969697, (1, 1): 0.006060606060606061, (1, 2): 0.024242424242424242}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 160.0 -> 161.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 160.0 -> 161.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 100.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=111.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.08108108108108109, (2, 1): 0.9009009009009009, (2, 2): 0.018018018018018018}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.08108108108108109, (2, 1): 0.9009009009009009, (2, 2): 0.018018018018018018}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 126.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=132.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9545454545454546, (2, 1): 0.030303030303030304, (2, 2): 0.015151515151515152}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9545454545454546, (2, 1): 0.030303030303030304, (2, 2): 0.015151515151515152}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 126.0 -> 126.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 139.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=144.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9652777777777778, (2, 1): 0.027777777777777776, (2, 2): 0.006944444444444444}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9652777777777778, (2, 1): 0.027777777777777776, (2, 2): 0.006944444444444444}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 139.0}
in get_filtered_urn(filter=0) --- total: total=141.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0070921985815602835, (0, 1): 0.0070921985815602835, (0, 2): 0.9858156028368794}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0070921985815602835, (0, 1): 0.0070921985815602835, (0, 2): 0.9858156028368794}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 139.0 -> 140.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 139.0 -> 140.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 100.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=111.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.08108108108108109, (2, 1): 0.9009009009009009, (2, 2): 0.018018018018018018}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.08108108108108109, (2, 1): 0.9009009009009009, (2, 2): 0.018018018018018018}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 129.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=140.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014285714285714285, (0, 1): 0.9214285714285714, (0, 2): 0.06428571428571428}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.014285714285714285, (0, 1): 0.9214285714285714, (0, 2): 0.06428571428571428}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 9.0 -> 9.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 129.0 -> 129.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 161.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=163.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006134969325153374, (0, 1): 0.9877300613496932, (0, 2): 0.006134969325153374}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006134969325153374, (0, 1): 0.9877300613496932, (0, 2): 0.006134969325153374}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 161.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=166.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9698795180722891, (1, 1): 0.006024096385542169, (1, 2): 0.024096385542168676}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9698795180722891, (1, 1): 0.006024096385542169, (1, 2): 0.024096385542168676}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 161.0 -> 162.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 161.0 -> 162.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 129.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=135.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9555555555555556, (1, 1): 0.014814814814814815, (1, 2): 0.02962962962962963}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9555555555555556, (1, 1): 0.014814814814814815, (1, 2): 0.02962962962962963}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 129.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=140.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014285714285714285, (0, 1): 0.9214285714285714, (0, 2): 0.06428571428571428}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.014285714285714285, (0, 1): 0.9214285714285714, (0, 2): 0.06428571428571428}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 129.0 -> 130.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 129.0 -> 130.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 162.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=164.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006097560975609756, (0, 1): 0.9878048780487805, (0, 2): 0.006097560975609756}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006097560975609756, (0, 1): 0.9878048780487805, (0, 2): 0.006097560975609756}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 162.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=167.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9700598802395209, (1, 1): 0.005988023952095809, (1, 2): 0.023952095808383235}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.9700598802395209, (1, 1): 0.005988023952095809, (1, 2): 0.023952095808383235}
in decode_message(signal=1) Receiver 2 got option: (1, 2) and decoded action: 2
Receiver 2 received signals: [1] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 1): 162.0 -> 162.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 130.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=136.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9558823529411765, (1, 1): 0.014705882352941176, (1, 2): 0.029411764705882353}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9558823529411765, (1, 1): 0.014705882352941176, (1, 2): 0.029411764705882353}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 130.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=141.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014184397163120567, (0, 1): 0.9219858156028369, (0, 2): 0.06382978723404255}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.014184397163120567, (0, 1): 0.9219858156028369, (0, 2): 0.06382978723404255}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 130.0 -> 131.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 130.0 -> 131.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 204.0}
in get_filtered_urn(filter=1) --- total: total=206.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0048543689320388345, (1, 1): 0.0048543689320388345, (1, 2): 0.9902912621359223}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0048543689320388345, (1, 1): 0.0048543689320388345, (1, 2): 0.9902912621359223}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 204.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=206.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0048543689320388345, (2, 1): 0.9902912621359223, (2, 2): 0.0048543689320388345}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0048543689320388345, (2, 1): 0.9902912621359223, (2, 2): 0.0048543689320388345}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 204.0 -> 205.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 204.0 -> 205.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 131.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=137.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9562043795620438, (1, 1): 0.014598540145985401, (1, 2): 0.029197080291970802}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9562043795620438, (1, 1): 0.014598540145985401, (1, 2): 0.029197080291970802}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 131.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=142.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014084507042253521, (0, 1): 0.9225352112676056, (0, 2): 0.06338028169014084}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.014084507042253521, (0, 1): 0.9225352112676056, (0, 2): 0.06338028169014084}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 131.0 -> 132.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 131.0 -> 132.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 140.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=145.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9655172413793104, (2, 1): 0.027586206896551724, (2, 2): 0.006896551724137931}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9655172413793104, (2, 1): 0.027586206896551724, (2, 2): 0.006896551724137931}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 140.0}
in get_filtered_urn(filter=0) --- total: total=142.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007042253521126761, (0, 1): 0.007042253521126761, (0, 2): 0.9859154929577465}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.007042253521126761, (0, 1): 0.007042253521126761, (0, 2): 0.9859154929577465}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 140.0 -> 141.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 140.0 -> 141.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 100.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=111.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.08108108108108109, (2, 1): 0.9009009009009009, (2, 2): 0.018018018018018018}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.08108108108108109, (2, 1): 0.9009009009009009, (2, 2): 0.018018018018018018}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 100.0}
in get_filtered_urn(filter=1) --- total: total=112.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.08928571428571429, (1, 1): 0.017857142857142856, (1, 2): 0.8928571428571429}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.08928571428571429, (1, 1): 0.017857142857142856, (1, 2): 0.8928571428571429}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 100.0 -> 101.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 100.0 -> 101.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 141.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=146.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9657534246575342, (2, 1): 0.0273972602739726, (2, 2): 0.00684931506849315}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9657534246575342, (2, 1): 0.0273972602739726, (2, 2): 0.00684931506849315}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 141.0}
in get_filtered_urn(filter=0) --- total: total=143.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006993006993006993, (0, 1): 0.006993006993006993, (0, 2): 0.986013986013986}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.006993006993006993, (0, 1): 0.006993006993006993, (0, 2): 0.986013986013986}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 141.0 -> 142.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 141.0 -> 142.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 126.0}
in get_filtered_urn(filter=0) --- total: total=138.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014492753623188406, (0, 1): 0.07246376811594203, (0, 2): 0.9130434782608695}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.014492753623188406, (0, 1): 0.07246376811594203, (0, 2): 0.9130434782608695}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 126.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=132.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9545454545454546, (2, 1): 0.030303030303030304, (2, 2): 0.015151515151515152}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9545454545454546, (2, 1): 0.030303030303030304, (2, 2): 0.015151515151515152}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 126.0 -> 127.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 126.0 -> 127.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 162.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=164.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006097560975609756, (0, 1): 0.9878048780487805, (0, 2): 0.006097560975609756}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006097560975609756, (0, 1): 0.9878048780487805, (0, 2): 0.006097560975609756}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 162.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=167.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9700598802395209, (1, 1): 0.005988023952095809, (1, 2): 0.023952095808383235}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9700598802395209, (1, 1): 0.005988023952095809, (1, 2): 0.023952095808383235}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 162.0 -> 163.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 162.0 -> 163.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 101.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=112.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.08035714285714286, (2, 1): 0.9017857142857143, (2, 2): 0.017857142857142856}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.08035714285714286, (2, 1): 0.9017857142857143, (2, 2): 0.017857142857142856}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 101.0}
in get_filtered_urn(filter=1) --- total: total=113.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.08849557522123894, (1, 1): 0.017699115044247787, (1, 2): 0.8938053097345132}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.08849557522123894, (1, 1): 0.017699115044247787, (1, 2): 0.8938053097345132}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 101.0 -> 101.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 142.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=147.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9659863945578231, (2, 1): 0.027210884353741496, (2, 2): 0.006802721088435374}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9659863945578231, (2, 1): 0.027210884353741496, (2, 2): 0.006802721088435374}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 142.0}
in get_filtered_urn(filter=0) --- total: total=144.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006944444444444444, (0, 1): 0.006944444444444444, (0, 2): 0.9861111111111112}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.006944444444444444, (0, 1): 0.006944444444444444, (0, 2): 0.9861111111111112}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 142.0 -> 143.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 142.0 -> 143.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 101.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=112.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.08035714285714286, (2, 1): 0.9017857142857143, (2, 2): 0.017857142857142856}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.08035714285714286, (2, 1): 0.9017857142857143, (2, 2): 0.017857142857142856}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 101.0}
in get_filtered_urn(filter=1) --- total: total=113.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.08849557522123894, (1, 1): 0.017699115044247787, (1, 2): 0.8938053097345132}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.08849557522123894, (1, 1): 0.017699115044247787, (1, 2): 0.8938053097345132}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 101.0 -> 102.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 101.0 -> 102.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 143.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=148.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9662162162162162, (2, 1): 0.02702702702702703, (2, 2): 0.006756756756756757}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9662162162162162, (2, 1): 0.02702702702702703, (2, 2): 0.006756756756756757}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 143.0}
in get_filtered_urn(filter=0) --- total: total=145.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006896551724137931, (0, 1): 0.006896551724137931, (0, 2): 0.9862068965517241}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.006896551724137931, (0, 1): 0.006896551724137931, (0, 2): 0.9862068965517241}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 143.0 -> 144.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 143.0 -> 144.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 102.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=113.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.07964601769911504, (2, 1): 0.9026548672566371, (2, 2): 0.017699115044247787}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.07964601769911504, (2, 1): 0.9026548672566371, (2, 2): 0.017699115044247787}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 102.0}
in get_filtered_urn(filter=1) --- total: total=114.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.08771929824561403, (1, 1): 0.017543859649122806, (1, 2): 0.8947368421052632}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.08771929824561403, (1, 1): 0.017543859649122806, (1, 2): 0.8947368421052632}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 102.0 -> 103.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 102.0 -> 103.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 163.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=165.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006060606060606061, (0, 1): 0.9878787878787879, (0, 2): 0.006060606060606061}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006060606060606061, (0, 1): 0.9878787878787879, (0, 2): 0.006060606060606061}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 163.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=168.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9702380952380952, (1, 1): 0.005952380952380952, (1, 2): 0.023809523809523808}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9702380952380952, (1, 1): 0.005952380952380952, (1, 2): 0.023809523809523808}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 163.0 -> 164.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 163.0 -> 164.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 103.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=114.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.07894736842105263, (2, 1): 0.9035087719298246, (2, 2): 0.017543859649122806}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.07894736842105263, (2, 1): 0.9035087719298246, (2, 2): 0.017543859649122806}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 103.0}
in get_filtered_urn(filter=1) --- total: total=115.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.08695652173913043, (1, 1): 0.017391304347826087, (1, 2): 0.8956521739130435}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.08695652173913043, (1, 1): 0.017391304347826087, (1, 2): 0.8956521739130435}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 103.0 -> 104.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 103.0 -> 104.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 205.0}
in get_filtered_urn(filter=1) --- total: total=207.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004830917874396135, (1, 1): 0.004830917874396135, (1, 2): 0.9903381642512077}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004830917874396135, (1, 1): 0.004830917874396135, (1, 2): 0.9903381642512077}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 205.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=207.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004830917874396135, (2, 1): 0.9903381642512077, (2, 2): 0.004830917874396135}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004830917874396135, (2, 1): 0.9903381642512077, (2, 2): 0.004830917874396135}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 205.0 -> 206.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 205.0 -> 206.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 104.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=115.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0782608695652174, (2, 1): 0.9043478260869565, (2, 2): 0.017391304347826087}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0782608695652174, (2, 1): 0.9043478260869565, (2, 2): 0.017391304347826087}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 104.0}
in get_filtered_urn(filter=1) --- total: total=116.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.08620689655172414, (1, 1): 0.017241379310344827, (1, 2): 0.896551724137931}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.08620689655172414, (1, 1): 0.017241379310344827, (1, 2): 0.896551724137931}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 104.0 -> 105.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 104.0 -> 105.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 206.0}
in get_filtered_urn(filter=1) --- total: total=208.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004807692307692308, (1, 1): 0.004807692307692308, (1, 2): 0.9903846153846154}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004807692307692308, (1, 1): 0.004807692307692308, (1, 2): 0.9903846153846154}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 206.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=208.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004807692307692308, (2, 1): 0.9903846153846154, (2, 2): 0.004807692307692308}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004807692307692308, (2, 1): 0.9903846153846154, (2, 2): 0.004807692307692308}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 206.0 -> 207.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 206.0 -> 207.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 105.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=116.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.07758620689655173, (2, 1): 0.9051724137931034, (2, 2): 0.017241379310344827}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.07758620689655173, (2, 1): 0.9051724137931034, (2, 2): 0.017241379310344827}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 105.0}
in get_filtered_urn(filter=1) --- total: total=117.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.08547008547008547, (1, 1): 0.017094017094017096, (1, 2): 0.8974358974358975}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.08547008547008547, (1, 1): 0.017094017094017096, (1, 2): 0.8974358974358975}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 105.0 -> 106.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 105.0 -> 106.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 144.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=149.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9664429530201343, (2, 1): 0.026845637583892617, (2, 2): 0.006711409395973154}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9664429530201343, (2, 1): 0.026845637583892617, (2, 2): 0.006711409395973154}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 144.0}
in get_filtered_urn(filter=0) --- total: total=146.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00684931506849315, (0, 1): 0.00684931506849315, (0, 2): 0.9863013698630136}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00684931506849315, (0, 1): 0.00684931506849315, (0, 2): 0.9863013698630136}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 144.0 -> 145.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 144.0 -> 145.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 132.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=138.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9565217391304348, (1, 1): 0.014492753623188406, (1, 2): 0.028985507246376812}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9565217391304348, (1, 1): 0.014492753623188406, (1, 2): 0.028985507246376812}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 132.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=143.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013986013986013986, (0, 1): 0.9230769230769231, (0, 2): 0.06293706293706294}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.013986013986013986, (0, 1): 0.9230769230769231, (0, 2): 0.06293706293706294}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 132.0 -> 133.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 132.0 -> 133.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 145.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=150.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9666666666666667, (2, 1): 0.02666666666666667, (2, 2): 0.006666666666666667}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.9666666666666667, (2, 1): 0.02666666666666667, (2, 2): 0.006666666666666667}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 164.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=169.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9704142011834319, (1, 1): 0.005917159763313609, (1, 2): 0.023668639053254437}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9704142011834319, (1, 1): 0.005917159763313609, (1, 2): 0.023668639053254437}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 1): 4.0 -> 4.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 0): 164.0 -> 164.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 127.0}
in get_filtered_urn(filter=0) --- total: total=139.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014388489208633094, (0, 1): 0.07194244604316546, (0, 2): 0.9136690647482014}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.014388489208633094, (0, 1): 0.07194244604316546, (0, 2): 0.9136690647482014}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 127.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=133.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9548872180451128, (2, 1): 0.03007518796992481, (2, 2): 0.015037593984962405}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9548872180451128, (2, 1): 0.03007518796992481, (2, 2): 0.015037593984962405}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 127.0 -> 128.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 127.0 -> 128.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 207.0}
in get_filtered_urn(filter=1) --- total: total=209.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004784688995215311, (1, 1): 0.004784688995215311, (1, 2): 0.9904306220095693}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004784688995215311, (1, 1): 0.004784688995215311, (1, 2): 0.9904306220095693}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 207.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=209.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004784688995215311, (2, 1): 0.9904306220095693, (2, 2): 0.004784688995215311}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004784688995215311, (2, 1): 0.9904306220095693, (2, 2): 0.004784688995215311}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 207.0 -> 208.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 207.0 -> 208.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 133.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=139.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9568345323741008, (1, 1): 0.014388489208633094, (1, 2): 0.02877697841726619}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9568345323741008, (1, 1): 0.014388489208633094, (1, 2): 0.02877697841726619}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 133.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=144.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013888888888888888, (0, 1): 0.9236111111111112, (0, 2): 0.0625}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.013888888888888888, (0, 1): 0.9236111111111112, (0, 2): 0.0625}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 133.0 -> 134.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 133.0 -> 134.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 145.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=150.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9666666666666667, (2, 1): 0.02666666666666667, (2, 2): 0.006666666666666667}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9666666666666667, (2, 1): 0.02666666666666667, (2, 2): 0.006666666666666667}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 145.0}
in get_filtered_urn(filter=0) --- total: total=147.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006802721088435374, (0, 1): 0.006802721088435374, (0, 2): 0.9863945578231292}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.006802721088435374, (0, 1): 0.006802721088435374, (0, 2): 0.9863945578231292}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 145.0 -> 146.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 145.0 -> 146.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 106.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=117.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.07692307692307693, (2, 1): 0.905982905982906, (2, 2): 0.017094017094017096}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.07692307692307693, (2, 1): 0.905982905982906, (2, 2): 0.017094017094017096}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 106.0}
in get_filtered_urn(filter=1) --- total: total=118.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0847457627118644, (1, 1): 0.01694915254237288, (1, 2): 0.8983050847457628}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0847457627118644, (1, 1): 0.01694915254237288, (1, 2): 0.8983050847457628}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 106.0 -> 107.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 106.0 -> 107.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 164.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=166.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006024096385542169, (0, 1): 0.9879518072289156, (0, 2): 0.006024096385542169}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.006024096385542169, (0, 1): 0.9879518072289156, (0, 2): 0.006024096385542169}
Sender 1 got filter 0 choose option: (0, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 146.0}
in get_filtered_urn(filter=0) --- total: total=148.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006756756756756757, (0, 1): 0.006756756756756757, (0, 2): 0.9864864864864865}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.006756756756756757, (0, 1): 0.006756756756756757, (0, 2): 0.9864864864864865}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 0): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 2): 146.0 -> 146.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 128.0}
in get_filtered_urn(filter=0) --- total: total=140.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014285714285714285, (0, 1): 0.07142857142857142, (0, 2): 0.9142857142857143}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.014285714285714285, (0, 1): 0.07142857142857142, (0, 2): 0.9142857142857143}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 128.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=134.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9552238805970149, (2, 1): 0.029850746268656716, (2, 2): 0.014925373134328358}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9552238805970149, (2, 1): 0.029850746268656716, (2, 2): 0.014925373134328358}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 128.0 -> 129.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 128.0 -> 129.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 208.0}
in get_filtered_urn(filter=1) --- total: total=210.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004761904761904762, (1, 1): 0.004761904761904762, (1, 2): 0.9904761904761905}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004761904761904762, (1, 1): 0.004761904761904762, (1, 2): 0.9904761904761905}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 208.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=210.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004761904761904762, (2, 1): 0.9904761904761905, (2, 2): 0.004761904761904762}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.004761904761904762, (2, 1): 0.9904761904761905, (2, 2): 0.004761904761904762}
in decode_message(signal=2) Receiver 2 got option: (2, 2) and decoded action: 2
Receiver 2 received signals: [2] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (1, 2): 208.0 -> 208.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 2): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 107.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=118.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.07627118644067797, (2, 1): 0.9067796610169492, (2, 2): 0.01694915254237288}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.07627118644067797, (2, 1): 0.9067796610169492, (2, 2): 0.01694915254237288}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 107.0}
in get_filtered_urn(filter=1) --- total: total=119.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.08403361344537816, (1, 1): 0.01680672268907563, (1, 2): 0.8991596638655462}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.08403361344537816, (1, 1): 0.01680672268907563, (1, 2): 0.8991596638655462}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 107.0 -> 108.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 107.0 -> 108.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 146.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=151.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9668874172185431, (2, 1): 0.026490066225165563, (2, 2): 0.006622516556291391}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9668874172185431, (2, 1): 0.026490066225165563, (2, 2): 0.006622516556291391}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 146.0}
in get_filtered_urn(filter=0) --- total: total=148.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006756756756756757, (0, 1): 0.006756756756756757, (0, 2): 0.9864864864864865}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.006756756756756757, (0, 1): 0.006756756756756757, (0, 2): 0.9864864864864865}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 146.0 -> 147.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 146.0 -> 147.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 134.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=140.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9571428571428572, (1, 1): 0.014285714285714285, (1, 2): 0.02857142857142857}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9571428571428572, (1, 1): 0.014285714285714285, (1, 2): 0.02857142857142857}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 134.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=145.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013793103448275862, (0, 1): 0.9241379310344827, (0, 2): 0.06206896551724138}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.013793103448275862, (0, 1): 0.9241379310344827, (0, 2): 0.06206896551724138}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 134.0 -> 135.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 134.0 -> 135.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 147.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=152.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9671052631578947, (2, 1): 0.02631578947368421, (2, 2): 0.006578947368421052}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9671052631578947, (2, 1): 0.02631578947368421, (2, 2): 0.006578947368421052}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 147.0}
in get_filtered_urn(filter=0) --- total: total=149.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006711409395973154, (0, 1): 0.006711409395973154, (0, 2): 0.9865771812080537}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.006711409395973154, (0, 1): 0.006711409395973154, (0, 2): 0.9865771812080537}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 147.0 -> 148.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 147.0 -> 148.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 108.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=119.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.07563025210084033, (2, 1): 0.907563025210084, (2, 2): 0.01680672268907563}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.07563025210084033, (2, 1): 0.907563025210084, (2, 2): 0.01680672268907563}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 108.0}
in get_filtered_urn(filter=1) --- total: total=120.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.08333333333333333, (1, 1): 0.016666666666666666, (1, 2): 0.9}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.08333333333333333, (1, 1): 0.016666666666666666, (1, 2): 0.9}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 108.0 -> 109.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 108.0 -> 109.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 208.0}
in get_filtered_urn(filter=1) --- total: total=210.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004761904761904762, (1, 1): 0.004761904761904762, (1, 2): 0.9904761904761905}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004761904761904762, (1, 1): 0.004761904761904762, (1, 2): 0.9904761904761905}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 208.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=210.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004761904761904762, (2, 1): 0.9904761904761905, (2, 2): 0.004761904761904762}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004761904761904762, (2, 1): 0.9904761904761905, (2, 2): 0.004761904761904762}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 208.0 -> 209.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 208.0 -> 209.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 135.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=141.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9574468085106383, (1, 1): 0.014184397163120567, (1, 2): 0.028368794326241134}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9574468085106383, (1, 1): 0.014184397163120567, (1, 2): 0.028368794326241134}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 135.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=146.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0136986301369863, (0, 1): 0.9246575342465754, (0, 2): 0.06164383561643835}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0136986301369863, (0, 1): 0.9246575342465754, (0, 2): 0.06164383561643835}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 135.0 -> 136.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 135.0 -> 136.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 209.0}
in get_filtered_urn(filter=1) --- total: total=211.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004739336492890996, (1, 1): 0.004739336492890996, (1, 2): 0.990521327014218}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.004739336492890996, (1, 1): 0.004739336492890996, (1, 2): 0.990521327014218}
Sender 1 got filter 1 choose option: (1, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 164.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=169.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9704142011834319, (1, 1): 0.005917159763313609, (1, 2): 0.023668639053254437}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9704142011834319, (1, 1): 0.005917159763313609, (1, 2): 0.023668639053254437}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (1, 1): 1.0 -> 1.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 0): 164.0 -> 164.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 136.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=142.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9577464788732394, (1, 1): 0.014084507042253521, (1, 2): 0.028169014084507043}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9577464788732394, (1, 1): 0.014084507042253521, (1, 2): 0.028169014084507043}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 136.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=147.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013605442176870748, (0, 1): 0.9251700680272109, (0, 2): 0.061224489795918366}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.013605442176870748, (0, 1): 0.9251700680272109, (0, 2): 0.061224489795918366}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 136.0 -> 137.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 136.0 -> 137.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 148.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=153.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9673202614379085, (2, 1): 0.026143790849673203, (2, 2): 0.006535947712418301}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9673202614379085, (2, 1): 0.026143790849673203, (2, 2): 0.006535947712418301}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 148.0}
in get_filtered_urn(filter=0) --- total: total=150.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006666666666666667, (0, 1): 0.006666666666666667, (0, 2): 0.9866666666666667}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.006666666666666667, (0, 1): 0.006666666666666667, (0, 2): 0.9866666666666667}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 148.0 -> 149.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 148.0 -> 149.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 109.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=120.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.075, (2, 1): 0.9083333333333333, (2, 2): 0.016666666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.075, (2, 1): 0.9083333333333333, (2, 2): 0.016666666666666666}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 109.0}
in get_filtered_urn(filter=1) --- total: total=121.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.08264462809917356, (1, 1): 0.01652892561983471, (1, 2): 0.9008264462809917}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.08264462809917356, (1, 1): 0.01652892561983471, (1, 2): 0.9008264462809917}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 109.0 -> 110.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 109.0 -> 110.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 164.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=166.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006024096385542169, (0, 1): 0.9879518072289156, (0, 2): 0.006024096385542169}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006024096385542169, (0, 1): 0.9879518072289156, (0, 2): 0.006024096385542169}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 164.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=169.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9704142011834319, (1, 1): 0.005917159763313609, (1, 2): 0.023668639053254437}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9704142011834319, (1, 1): 0.005917159763313609, (1, 2): 0.023668639053254437}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 164.0 -> 165.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 164.0 -> 165.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 110.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=121.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0743801652892562, (2, 1): 0.9090909090909091, (2, 2): 0.01652892561983471}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0743801652892562, (2, 1): 0.9090909090909091, (2, 2): 0.01652892561983471}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 110.0}
in get_filtered_urn(filter=1) --- total: total=122.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.08196721311475409, (1, 1): 0.01639344262295082, (1, 2): 0.9016393442622951}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.08196721311475409, (1, 1): 0.01639344262295082, (1, 2): 0.9016393442622951}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 110.0 -> 111.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 110.0 -> 111.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 149.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=154.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9675324675324676, (2, 1): 0.025974025974025976, (2, 2): 0.006493506493506494}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9675324675324676, (2, 1): 0.025974025974025976, (2, 2): 0.006493506493506494}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 149.0}
in get_filtered_urn(filter=0) --- total: total=151.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006622516556291391, (0, 1): 0.006622516556291391, (0, 2): 0.9867549668874173}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006622516556291391, (0, 1): 0.006622516556291391, (0, 2): 0.9867549668874173}
in decode_message(signal=0) Receiver 2 got option: (0, 1) and decoded action: 1
Receiver 2 received signals: [0] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 0): 149.0 -> 149.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 1): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 129.0}
in get_filtered_urn(filter=0) --- total: total=141.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014184397163120567, (0, 1): 0.07092198581560284, (0, 2): 0.9148936170212766}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.014184397163120567, (0, 1): 0.07092198581560284, (0, 2): 0.9148936170212766}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 129.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=135.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9555555555555556, (2, 1): 0.02962962962962963, (2, 2): 0.014814814814814815}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9555555555555556, (2, 1): 0.02962962962962963, (2, 2): 0.014814814814814815}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 129.0 -> 130.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 129.0 -> 130.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 209.0}
in get_filtered_urn(filter=1) --- total: total=211.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004739336492890996, (1, 1): 0.004739336492890996, (1, 2): 0.990521327014218}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004739336492890996, (1, 1): 0.004739336492890996, (1, 2): 0.990521327014218}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 209.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=211.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004739336492890996, (2, 1): 0.990521327014218, (2, 2): 0.004739336492890996}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004739336492890996, (2, 1): 0.990521327014218, (2, 2): 0.004739336492890996}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 209.0 -> 210.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 209.0 -> 210.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 130.0}
in get_filtered_urn(filter=0) --- total: total=142.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.014084507042253521, (0, 1): 0.07042253521126761, (0, 2): 0.9154929577464789}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.014084507042253521, (0, 1): 0.07042253521126761, (0, 2): 0.9154929577464789}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 130.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=136.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9558823529411765, (2, 1): 0.029411764705882353, (2, 2): 0.014705882352941176}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9558823529411765, (2, 1): 0.029411764705882353, (2, 2): 0.014705882352941176}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 130.0 -> 131.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 130.0 -> 131.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 165.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=167.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005988023952095809, (0, 1): 0.9880239520958084, (0, 2): 0.005988023952095809}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005988023952095809, (0, 1): 0.9880239520958084, (0, 2): 0.005988023952095809}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 165.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=170.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9705882352941176, (1, 1): 0.0058823529411764705, (1, 2): 0.023529411764705882}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9705882352941176, (1, 1): 0.0058823529411764705, (1, 2): 0.023529411764705882}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 165.0 -> 166.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 165.0 -> 166.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 131.0}
in get_filtered_urn(filter=0) --- total: total=143.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013986013986013986, (0, 1): 0.06993006993006994, (0, 2): 0.916083916083916}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.013986013986013986, (0, 1): 0.06993006993006994, (0, 2): 0.916083916083916}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 131.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=137.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9562043795620438, (2, 1): 0.029197080291970802, (2, 2): 0.014598540145985401}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9562043795620438, (2, 1): 0.029197080291970802, (2, 2): 0.014598540145985401}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 131.0 -> 132.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 131.0 -> 132.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 166.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=168.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005952380952380952, (0, 1): 0.9880952380952381, (0, 2): 0.005952380952380952}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005952380952380952, (0, 1): 0.9880952380952381, (0, 2): 0.005952380952380952}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 166.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=171.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9707602339181286, (1, 1): 0.005847953216374269, (1, 2): 0.023391812865497075}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9707602339181286, (1, 1): 0.005847953216374269, (1, 2): 0.023391812865497075}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 166.0 -> 167.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 166.0 -> 167.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 137.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=143.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.958041958041958, (1, 1): 0.013986013986013986, (1, 2): 0.027972027972027972}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.958041958041958, (1, 1): 0.013986013986013986, (1, 2): 0.027972027972027972}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 137.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=148.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013513513513513514, (0, 1): 0.9256756756756757, (0, 2): 0.060810810810810814}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.013513513513513514, (0, 1): 0.9256756756756757, (0, 2): 0.060810810810810814}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 137.0 -> 138.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 137.0 -> 138.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 167.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=169.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005917159763313609, (0, 1): 0.9881656804733728, (0, 2): 0.005917159763313609}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005917159763313609, (0, 1): 0.9881656804733728, (0, 2): 0.005917159763313609}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 167.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=172.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9709302325581395, (1, 1): 0.005813953488372093, (1, 2): 0.023255813953488372}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9709302325581395, (1, 1): 0.005813953488372093, (1, 2): 0.023255813953488372}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 167.0 -> 168.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 167.0 -> 168.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 138.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=144.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9583333333333334, (1, 1): 0.013888888888888888, (1, 2): 0.027777777777777776}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9583333333333334, (1, 1): 0.013888888888888888, (1, 2): 0.027777777777777776}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 138.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=149.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013422818791946308, (0, 1): 0.9261744966442953, (0, 2): 0.06040268456375839}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.013422818791946308, (0, 1): 0.9261744966442953, (0, 2): 0.06040268456375839}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 138.0 -> 139.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 138.0 -> 139.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 149.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=154.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9675324675324676, (2, 1): 0.025974025974025976, (2, 2): 0.006493506493506494}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9675324675324676, (2, 1): 0.025974025974025976, (2, 2): 0.006493506493506494}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 149.0}
in get_filtered_urn(filter=0) --- total: total=151.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006622516556291391, (0, 1): 0.006622516556291391, (0, 2): 0.9867549668874173}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.006622516556291391, (0, 1): 0.006622516556291391, (0, 2): 0.9867549668874173}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 149.0 -> 150.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 149.0 -> 150.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 139.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=145.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9586206896551724, (1, 1): 0.013793103448275862, (1, 2): 0.027586206896551724}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9586206896551724, (1, 1): 0.013793103448275862, (1, 2): 0.027586206896551724}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 139.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=150.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013333333333333334, (0, 1): 0.9266666666666666, (0, 2): 0.06}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.013333333333333334, (0, 1): 0.9266666666666666, (0, 2): 0.06}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 139.0 -> 140.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 139.0 -> 140.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 168.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=170.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0058823529411764705, (0, 1): 0.9882352941176471, (0, 2): 0.0058823529411764705}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0058823529411764705, (0, 1): 0.9882352941176471, (0, 2): 0.0058823529411764705}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 168.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=173.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9710982658959537, (1, 1): 0.005780346820809248, (1, 2): 0.023121387283236993}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9710982658959537, (1, 1): 0.005780346820809248, (1, 2): 0.023121387283236993}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 168.0 -> 169.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 168.0 -> 169.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 111.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=122.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.07377049180327869, (2, 1): 0.9098360655737705, (2, 2): 0.01639344262295082}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.07377049180327869, (2, 1): 0.9098360655737705, (2, 2): 0.01639344262295082}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 111.0}
in get_filtered_urn(filter=1) --- total: total=123.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.08130081300813008, (1, 1): 0.016260162601626018, (1, 2): 0.9024390243902439}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.08130081300813008, (1, 1): 0.016260162601626018, (1, 2): 0.9024390243902439}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 111.0 -> 111.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 169.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=171.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005847953216374269, (0, 1): 0.9883040935672515, (0, 2): 0.005847953216374269}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005847953216374269, (0, 1): 0.9883040935672515, (0, 2): 0.005847953216374269}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 169.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=174.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9712643678160919, (1, 1): 0.005747126436781609, (1, 2): 0.022988505747126436}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9712643678160919, (1, 1): 0.005747126436781609, (1, 2): 0.022988505747126436}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 169.0 -> 170.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 169.0 -> 170.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 111.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=122.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.07377049180327869, (2, 1): 0.9098360655737705, (2, 2): 0.01639344262295082}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.07377049180327869, (2, 1): 0.9098360655737705, (2, 2): 0.01639344262295082}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 111.0}
in get_filtered_urn(filter=1) --- total: total=123.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.08130081300813008, (1, 1): 0.016260162601626018, (1, 2): 0.9024390243902439}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.08130081300813008, (1, 1): 0.016260162601626018, (1, 2): 0.9024390243902439}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 111.0 -> 111.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 170.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=172.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005813953488372093, (0, 1): 0.9883720930232558, (0, 2): 0.005813953488372093}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005813953488372093, (0, 1): 0.9883720930232558, (0, 2): 0.005813953488372093}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 170.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=175.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9714285714285714, (1, 1): 0.005714285714285714, (1, 2): 0.022857142857142857}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9714285714285714, (1, 1): 0.005714285714285714, (1, 2): 0.022857142857142857}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 170.0 -> 171.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 170.0 -> 171.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 132.0}
in get_filtered_urn(filter=0) --- total: total=144.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013888888888888888, (0, 1): 0.06944444444444445, (0, 2): 0.9166666666666666}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.013888888888888888, (0, 1): 0.06944444444444445, (0, 2): 0.9166666666666666}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 132.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=138.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9565217391304348, (2, 1): 0.028985507246376812, (2, 2): 0.014492753623188406}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9565217391304348, (2, 1): 0.028985507246376812, (2, 2): 0.014492753623188406}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 132.0 -> 133.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 132.0 -> 133.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 210.0}
in get_filtered_urn(filter=1) --- total: total=212.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0047169811320754715, (1, 1): 0.0047169811320754715, (1, 2): 0.9905660377358491}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0047169811320754715, (1, 1): 0.0047169811320754715, (1, 2): 0.9905660377358491}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 210.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=212.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0047169811320754715, (2, 1): 0.9905660377358491, (2, 2): 0.0047169811320754715}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0047169811320754715, (2, 1): 0.9905660377358491, (2, 2): 0.0047169811320754715}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 210.0 -> 211.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 210.0 -> 211.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 140.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=146.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.958904109589041, (1, 1): 0.0136986301369863, (1, 2): 0.0273972602739726}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.958904109589041, (1, 1): 0.0136986301369863, (1, 2): 0.0273972602739726}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 140.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=151.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013245033112582781, (0, 1): 0.9271523178807947, (0, 2): 0.059602649006622516}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.013245033112582781, (0, 1): 0.9271523178807947, (0, 2): 0.059602649006622516}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 140.0 -> 141.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 140.0 -> 141.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 171.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=173.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005780346820809248, (0, 1): 0.9884393063583815, (0, 2): 0.005780346820809248}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005780346820809248, (0, 1): 0.9884393063583815, (0, 2): 0.005780346820809248}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 171.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=176.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9715909090909091, (1, 1): 0.005681818181818182, (1, 2): 0.022727272727272728}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9715909090909091, (1, 1): 0.005681818181818182, (1, 2): 0.022727272727272728}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 171.0 -> 172.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 171.0 -> 172.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 141.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=147.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9591836734693877, (1, 1): 0.013605442176870748, (1, 2): 0.027210884353741496}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9591836734693877, (1, 1): 0.013605442176870748, (1, 2): 0.027210884353741496}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 141.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=152.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013157894736842105, (0, 1): 0.9276315789473685, (0, 2): 0.05921052631578947}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.013157894736842105, (0, 1): 0.9276315789473685, (0, 2): 0.05921052631578947}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 141.0 -> 142.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 141.0 -> 142.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 211.0}
in get_filtered_urn(filter=1) --- total: total=213.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004694835680751174, (1, 1): 0.004694835680751174, (1, 2): 0.9906103286384976}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004694835680751174, (1, 1): 0.004694835680751174, (1, 2): 0.9906103286384976}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 211.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=213.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004694835680751174, (2, 1): 0.9906103286384976, (2, 2): 0.004694835680751174}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004694835680751174, (2, 1): 0.9906103286384976, (2, 2): 0.004694835680751174}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 211.0 -> 212.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 211.0 -> 212.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 142.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=148.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9594594594594594, (1, 1): 0.013513513513513514, (1, 2): 0.02702702702702703}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9594594594594594, (1, 1): 0.013513513513513514, (1, 2): 0.02702702702702703}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 142.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=153.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013071895424836602, (0, 1): 0.9281045751633987, (0, 2): 0.058823529411764705}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.013071895424836602, (0, 1): 0.9281045751633987, (0, 2): 0.058823529411764705}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 142.0 -> 143.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 142.0 -> 143.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 172.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=174.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005747126436781609, (0, 1): 0.9885057471264368, (0, 2): 0.005747126436781609}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005747126436781609, (0, 1): 0.9885057471264368, (0, 2): 0.005747126436781609}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 172.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=177.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9717514124293786, (1, 1): 0.005649717514124294, (1, 2): 0.022598870056497175}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9717514124293786, (1, 1): 0.005649717514124294, (1, 2): 0.022598870056497175}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 172.0 -> 173.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 172.0 -> 173.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 143.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=149.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.959731543624161, (1, 1): 0.013422818791946308, (1, 2): 0.026845637583892617}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.959731543624161, (1, 1): 0.013422818791946308, (1, 2): 0.026845637583892617}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 143.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=154.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012987012987012988, (0, 1): 0.9285714285714286, (0, 2): 0.05844155844155844}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.012987012987012988, (0, 1): 0.9285714285714286, (0, 2): 0.05844155844155844}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 143.0 -> 144.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 143.0 -> 144.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 173.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=175.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005714285714285714, (0, 1): 0.9885714285714285, (0, 2): 0.005714285714285714}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005714285714285714, (0, 1): 0.9885714285714285, (0, 2): 0.005714285714285714}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 173.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=178.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9719101123595506, (1, 1): 0.0056179775280898875, (1, 2): 0.02247191011235955}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9719101123595506, (1, 1): 0.0056179775280898875, (1, 2): 0.02247191011235955}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 173.0 -> 174.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 173.0 -> 174.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 111.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=122.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.07377049180327869, (2, 1): 0.9098360655737705, (2, 2): 0.01639344262295082}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.07377049180327869, (2, 1): 0.9098360655737705, (2, 2): 0.01639344262295082}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 111.0}
in get_filtered_urn(filter=1) --- total: total=123.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.08130081300813008, (1, 1): 0.016260162601626018, (1, 2): 0.9024390243902439}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.08130081300813008, (1, 1): 0.016260162601626018, (1, 2): 0.9024390243902439}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 111.0 -> 112.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 111.0 -> 112.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 212.0}
in get_filtered_urn(filter=1) --- total: total=214.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004672897196261682, (1, 1): 0.004672897196261682, (1, 2): 0.9906542056074766}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004672897196261682, (1, 1): 0.004672897196261682, (1, 2): 0.9906542056074766}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 212.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=214.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004672897196261682, (2, 1): 0.9906542056074766, (2, 2): 0.004672897196261682}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004672897196261682, (2, 1): 0.9906542056074766, (2, 2): 0.004672897196261682}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 212.0 -> 213.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 212.0 -> 213.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 133.0}
in get_filtered_urn(filter=0) --- total: total=145.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013793103448275862, (0, 1): 0.06896551724137931, (0, 2): 0.9172413793103448}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.013793103448275862, (0, 1): 0.06896551724137931, (0, 2): 0.9172413793103448}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 133.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=139.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9568345323741008, (2, 1): 0.02877697841726619, (2, 2): 0.014388489208633094}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9568345323741008, (2, 1): 0.02877697841726619, (2, 2): 0.014388489208633094}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 133.0 -> 134.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 133.0 -> 134.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 174.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=176.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005681818181818182, (0, 1): 0.9886363636363636, (0, 2): 0.005681818181818182}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005681818181818182, (0, 1): 0.9886363636363636, (0, 2): 0.005681818181818182}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 174.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=179.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9720670391061452, (1, 1): 0.00558659217877095, (1, 2): 0.0223463687150838}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9720670391061452, (1, 1): 0.00558659217877095, (1, 2): 0.0223463687150838}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 174.0 -> 175.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 174.0 -> 175.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 112.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=123.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.07317073170731707, (2, 1): 0.9105691056910569, (2, 2): 0.016260162601626018}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.07317073170731707, (2, 1): 0.9105691056910569, (2, 2): 0.016260162601626018}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 112.0}
in get_filtered_urn(filter=1) --- total: total=124.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.08064516129032258, (1, 1): 0.016129032258064516, (1, 2): 0.9032258064516129}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.08064516129032258, (1, 1): 0.016129032258064516, (1, 2): 0.9032258064516129}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 112.0 -> 113.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 112.0 -> 113.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 213.0}
in get_filtered_urn(filter=1) --- total: total=215.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004651162790697674, (1, 1): 0.004651162790697674, (1, 2): 0.9906976744186047}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004651162790697674, (1, 1): 0.004651162790697674, (1, 2): 0.9906976744186047}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 213.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=215.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004651162790697674, (2, 1): 0.9906976744186047, (2, 2): 0.004651162790697674}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004651162790697674, (2, 1): 0.9906976744186047, (2, 2): 0.004651162790697674}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 213.0 -> 214.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 213.0 -> 214.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 144.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=150.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.96, (1, 1): 0.013333333333333334, (1, 2): 0.02666666666666667}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.96, (1, 1): 0.013333333333333334, (1, 2): 0.02666666666666667}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 144.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=155.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012903225806451613, (0, 1): 0.9290322580645162, (0, 2): 0.05806451612903226}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.012903225806451613, (0, 1): 0.9290322580645162, (0, 2): 0.05806451612903226}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 144.0 -> 145.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 144.0 -> 145.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 214.0}
in get_filtered_urn(filter=1) --- total: total=216.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004629629629629629, (1, 1): 0.004629629629629629, (1, 2): 0.9907407407407407}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004629629629629629, (1, 1): 0.004629629629629629, (1, 2): 0.9907407407407407}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 214.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=216.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004629629629629629, (2, 1): 0.9907407407407407, (2, 2): 0.004629629629629629}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004629629629629629, (2, 1): 0.9907407407407407, (2, 2): 0.004629629629629629}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 214.0 -> 215.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 214.0 -> 215.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 134.0}
in get_filtered_urn(filter=0) --- total: total=146.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0136986301369863, (0, 1): 0.0684931506849315, (0, 2): 0.9178082191780822}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0136986301369863, (0, 1): 0.0684931506849315, (0, 2): 0.9178082191780822}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 134.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=140.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9571428571428572, (2, 1): 0.02857142857142857, (2, 2): 0.014285714285714285}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9571428571428572, (2, 1): 0.02857142857142857, (2, 2): 0.014285714285714285}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 134.0 -> 135.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 134.0 -> 135.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 175.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=177.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005649717514124294, (0, 1): 0.9887005649717514, (0, 2): 0.005649717514124294}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005649717514124294, (0, 1): 0.9887005649717514, (0, 2): 0.005649717514124294}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 175.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=180.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9722222222222222, (1, 1): 0.005555555555555556, (1, 2): 0.022222222222222223}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9722222222222222, (1, 1): 0.005555555555555556, (1, 2): 0.022222222222222223}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 175.0 -> 176.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 175.0 -> 176.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 113.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=124.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.07258064516129033, (2, 1): 0.9112903225806451, (2, 2): 0.016129032258064516}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.07258064516129033, (2, 1): 0.9112903225806451, (2, 2): 0.016129032258064516}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 113.0}
in get_filtered_urn(filter=1) --- total: total=125.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.08, (1, 1): 0.016, (1, 2): 0.904}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.08, (1, 1): 0.016, (1, 2): 0.904}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 113.0 -> 114.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 113.0 -> 114.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 215.0}
in get_filtered_urn(filter=1) --- total: total=217.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004608294930875576, (1, 1): 0.004608294930875576, (1, 2): 0.9907834101382489}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004608294930875576, (1, 1): 0.004608294930875576, (1, 2): 0.9907834101382489}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 215.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=217.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004608294930875576, (2, 1): 0.9907834101382489, (2, 2): 0.004608294930875576}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004608294930875576, (2, 1): 0.9907834101382489, (2, 2): 0.004608294930875576}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 215.0 -> 216.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 215.0 -> 216.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 114.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=125.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.072, (2, 1): 0.912, (2, 2): 0.016}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.072, (2, 1): 0.912, (2, 2): 0.016}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 114.0}
in get_filtered_urn(filter=1) --- total: total=126.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.07936507936507936, (1, 1): 0.015873015873015872, (1, 2): 0.9047619047619048}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.07936507936507936, (1, 1): 0.015873015873015872, (1, 2): 0.9047619047619048}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 114.0 -> 115.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 114.0 -> 115.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 150.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=155.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.967741935483871, (2, 1): 0.025806451612903226, (2, 2): 0.0064516129032258064}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.967741935483871, (2, 1): 0.025806451612903226, (2, 2): 0.0064516129032258064}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 150.0}
in get_filtered_urn(filter=0) --- total: total=152.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006578947368421052, (0, 1): 0.006578947368421052, (0, 2): 0.9868421052631579}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.006578947368421052, (0, 1): 0.006578947368421052, (0, 2): 0.9868421052631579}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 150.0 -> 151.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 150.0 -> 151.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 145.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=151.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9602649006622517, (1, 1): 0.013245033112582781, (1, 2): 0.026490066225165563}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9602649006622517, (1, 1): 0.013245033112582781, (1, 2): 0.026490066225165563}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 145.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=156.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01282051282051282, (0, 1): 0.9294871794871795, (0, 2): 0.057692307692307696}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.01282051282051282, (0, 1): 0.9294871794871795, (0, 2): 0.057692307692307696}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 145.0 -> 146.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 145.0 -> 146.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 216.0}
in get_filtered_urn(filter=1) --- total: total=218.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0045871559633027525, (1, 1): 0.0045871559633027525, (1, 2): 0.9908256880733946}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0045871559633027525, (1, 1): 0.0045871559633027525, (1, 2): 0.9908256880733946}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 216.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=218.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0045871559633027525, (2, 1): 0.9908256880733946, (2, 2): 0.0045871559633027525}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0045871559633027525, (2, 1): 0.9908256880733946, (2, 2): 0.0045871559633027525}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 216.0 -> 217.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 216.0 -> 217.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 115.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=126.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.07142857142857142, (2, 1): 0.9126984126984127, (2, 2): 0.015873015873015872}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.07142857142857142, (2, 1): 0.9126984126984127, (2, 2): 0.015873015873015872}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 115.0}
in get_filtered_urn(filter=1) --- total: total=127.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.07874015748031496, (1, 1): 0.015748031496062992, (1, 2): 0.905511811023622}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.07874015748031496, (1, 1): 0.015748031496062992, (1, 2): 0.905511811023622}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 115.0 -> 115.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 217.0}
in get_filtered_urn(filter=1) --- total: total=219.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0045662100456621, (1, 1): 0.0045662100456621, (1, 2): 0.9908675799086758}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0045662100456621, (1, 1): 0.0045662100456621, (1, 2): 0.9908675799086758}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 217.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=219.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0045662100456621, (2, 1): 0.9908675799086758, (2, 2): 0.0045662100456621}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0045662100456621, (2, 1): 0.9908675799086758, (2, 2): 0.0045662100456621}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 217.0 -> 218.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 217.0 -> 218.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 115.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=126.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.07142857142857142, (2, 1): 0.9126984126984127, (2, 2): 0.015873015873015872}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.07142857142857142, (2, 1): 0.9126984126984127, (2, 2): 0.015873015873015872}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 115.0}
in get_filtered_urn(filter=1) --- total: total=127.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.07874015748031496, (1, 1): 0.015748031496062992, (1, 2): 0.905511811023622}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.07874015748031496, (1, 1): 0.015748031496062992, (1, 2): 0.905511811023622}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 115.0 -> 116.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 115.0 -> 116.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 176.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=178.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0056179775280898875, (0, 1): 0.9887640449438202, (0, 2): 0.0056179775280898875}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0056179775280898875, (0, 1): 0.9887640449438202, (0, 2): 0.0056179775280898875}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 176.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=181.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9723756906077348, (1, 1): 0.0055248618784530384, (1, 2): 0.022099447513812154}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9723756906077348, (1, 1): 0.0055248618784530384, (1, 2): 0.022099447513812154}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 176.0 -> 177.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 176.0 -> 177.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 116.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=127.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.07086614173228346, (2, 1): 0.9133858267716536, (2, 2): 0.015748031496062992}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.07086614173228346, (2, 1): 0.9133858267716536, (2, 2): 0.015748031496062992}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 116.0}
in get_filtered_urn(filter=1) --- total: total=128.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.078125, (1, 1): 0.015625, (1, 2): 0.90625}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.078125, (1, 1): 0.015625, (1, 2): 0.90625}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 116.0 -> 117.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 116.0 -> 117.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 151.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=156.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.967948717948718, (2, 1): 0.02564102564102564, (2, 2): 0.00641025641025641}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.967948717948718, (2, 1): 0.02564102564102564, (2, 2): 0.00641025641025641}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 177.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=182.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9725274725274725, (1, 1): 0.005494505494505495, (1, 2): 0.02197802197802198}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9725274725274725, (1, 1): 0.005494505494505495, (1, 2): 0.02197802197802198}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 1): 4.0 -> 4.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 0): 177.0 -> 177.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 117.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=128.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0703125, (2, 1): 0.9140625, (2, 2): 0.015625}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0703125, (2, 1): 0.9140625, (2, 2): 0.015625}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 117.0}
in get_filtered_urn(filter=1) --- total: total=129.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.07751937984496124, (1, 1): 0.015503875968992248, (1, 2): 0.9069767441860465}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.07751937984496124, (1, 1): 0.015503875968992248, (1, 2): 0.9069767441860465}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 117.0 -> 118.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 117.0 -> 118.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 177.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=179.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00558659217877095, (0, 1): 0.9888268156424581, (0, 2): 0.00558659217877095}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00558659217877095, (0, 1): 0.9888268156424581, (0, 2): 0.00558659217877095}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 177.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=182.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9725274725274725, (1, 1): 0.005494505494505495, (1, 2): 0.02197802197802198}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9725274725274725, (1, 1): 0.005494505494505495, (1, 2): 0.02197802197802198}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 177.0 -> 178.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 177.0 -> 178.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 135.0}
in get_filtered_urn(filter=0) --- total: total=147.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013605442176870748, (0, 1): 0.06802721088435375, (0, 2): 0.9183673469387755}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.013605442176870748, (0, 1): 0.06802721088435375, (0, 2): 0.9183673469387755}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 135.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=141.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9574468085106383, (2, 1): 0.028368794326241134, (2, 2): 0.014184397163120567}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9574468085106383, (2, 1): 0.028368794326241134, (2, 2): 0.014184397163120567}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 135.0 -> 136.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 135.0 -> 136.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 151.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=156.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.967948717948718, (2, 1): 0.02564102564102564, (2, 2): 0.00641025641025641}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.967948717948718, (2, 1): 0.02564102564102564, (2, 2): 0.00641025641025641}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 151.0}
in get_filtered_urn(filter=0) --- total: total=153.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006535947712418301, (0, 1): 0.006535947712418301, (0, 2): 0.9869281045751634}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.006535947712418301, (0, 1): 0.006535947712418301, (0, 2): 0.9869281045751634}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 151.0 -> 152.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 151.0 -> 152.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 118.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=129.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.06976744186046512, (2, 1): 0.9147286821705426, (2, 2): 0.015503875968992248}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.06976744186046512, (2, 1): 0.9147286821705426, (2, 2): 0.015503875968992248}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 118.0}
in get_filtered_urn(filter=1) --- total: total=130.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.07692307692307693, (1, 1): 0.015384615384615385, (1, 2): 0.9076923076923077}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.07692307692307693, (1, 1): 0.015384615384615385, (1, 2): 0.9076923076923077}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 118.0 -> 119.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 118.0 -> 119.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 152.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=157.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9681528662420382, (2, 1): 0.025477707006369428, (2, 2): 0.006369426751592357}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9681528662420382, (2, 1): 0.025477707006369428, (2, 2): 0.006369426751592357}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 152.0}
in get_filtered_urn(filter=0) --- total: total=154.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006493506493506494, (0, 1): 0.006493506493506494, (0, 2): 0.987012987012987}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.006493506493506494, (0, 1): 0.006493506493506494, (0, 2): 0.987012987012987}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 152.0 -> 153.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 152.0 -> 153.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 146.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=152.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9605263157894737, (1, 1): 0.013157894736842105, (1, 2): 0.02631578947368421}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9605263157894737, (1, 1): 0.013157894736842105, (1, 2): 0.02631578947368421}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 146.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=157.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012738853503184714, (0, 1): 0.9299363057324841, (0, 2): 0.05732484076433121}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.012738853503184714, (0, 1): 0.9299363057324841, (0, 2): 0.05732484076433121}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 146.0 -> 147.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 146.0 -> 147.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 178.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=180.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005555555555555556, (0, 1): 0.9888888888888889, (0, 2): 0.005555555555555556}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005555555555555556, (0, 1): 0.9888888888888889, (0, 2): 0.005555555555555556}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 178.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=183.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9726775956284153, (1, 1): 0.00546448087431694, (1, 2): 0.02185792349726776}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9726775956284153, (1, 1): 0.00546448087431694, (1, 2): 0.02185792349726776}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 178.0 -> 179.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 178.0 -> 179.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 136.0}
in get_filtered_urn(filter=0) --- total: total=148.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013513513513513514, (0, 1): 0.06756756756756757, (0, 2): 0.918918918918919}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.013513513513513514, (0, 1): 0.06756756756756757, (0, 2): 0.918918918918919}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 119.0}
in get_filtered_urn(filter=1) --- total: total=131.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.07633587786259542, (1, 1): 0.015267175572519083, (1, 2): 0.9083969465648855}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.07633587786259542, (1, 1): 0.015267175572519083, (1, 2): 0.9083969465648855}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 119.0 -> 119.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 179.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=181.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0055248618784530384, (0, 1): 0.988950276243094, (0, 2): 0.0055248618784530384}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0055248618784530384, (0, 1): 0.988950276243094, (0, 2): 0.0055248618784530384}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 179.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=184.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9728260869565217, (1, 1): 0.005434782608695652, (1, 2): 0.021739130434782608}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9728260869565217, (1, 1): 0.005434782608695652, (1, 2): 0.021739130434782608}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 179.0 -> 180.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 179.0 -> 180.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 119.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=130.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.06923076923076923, (2, 1): 0.9153846153846154, (2, 2): 0.015384615384615385}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.06923076923076923, (2, 1): 0.9153846153846154, (2, 2): 0.015384615384615385}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 119.0}
in get_filtered_urn(filter=1) --- total: total=131.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.07633587786259542, (1, 1): 0.015267175572519083, (1, 2): 0.9083969465648855}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.07633587786259542, (1, 1): 0.015267175572519083, (1, 2): 0.9083969465648855}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 119.0 -> 120.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 119.0 -> 120.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 180.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=182.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005494505494505495, (0, 1): 0.989010989010989, (0, 2): 0.005494505494505495}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005494505494505495, (0, 1): 0.989010989010989, (0, 2): 0.005494505494505495}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 180.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=185.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.972972972972973, (1, 1): 0.005405405405405406, (1, 2): 0.021621621621621623}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.972972972972973, (1, 1): 0.005405405405405406, (1, 2): 0.021621621621621623}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 180.0 -> 181.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 180.0 -> 181.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 136.0}
in get_filtered_urn(filter=0) --- total: total=148.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013513513513513514, (0, 1): 0.06756756756756757, (0, 2): 0.918918918918919}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.013513513513513514, (0, 1): 0.06756756756756757, (0, 2): 0.918918918918919}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 136.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=142.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9577464788732394, (2, 1): 0.028169014084507043, (2, 2): 0.014084507042253521}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9577464788732394, (2, 1): 0.028169014084507043, (2, 2): 0.014084507042253521}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 136.0 -> 137.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 136.0 -> 137.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 153.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=158.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9683544303797469, (2, 1): 0.02531645569620253, (2, 2): 0.006329113924050633}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9683544303797469, (2, 1): 0.02531645569620253, (2, 2): 0.006329113924050633}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 153.0}
in get_filtered_urn(filter=0) --- total: total=155.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0064516129032258064, (0, 1): 0.0064516129032258064, (0, 2): 0.9870967741935484}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0064516129032258064, (0, 1): 0.0064516129032258064, (0, 2): 0.9870967741935484}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 153.0 -> 154.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 153.0 -> 154.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 147.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=153.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9607843137254902, (1, 1): 0.013071895424836602, (1, 2): 0.026143790849673203}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9607843137254902, (1, 1): 0.013071895424836602, (1, 2): 0.026143790849673203}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 147.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=158.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012658227848101266, (0, 1): 0.930379746835443, (0, 2): 0.056962025316455694}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.012658227848101266, (0, 1): 0.930379746835443, (0, 2): 0.056962025316455694}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 147.0 -> 148.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 147.0 -> 148.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 218.0}
in get_filtered_urn(filter=1) --- total: total=220.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004545454545454545, (1, 1): 0.004545454545454545, (1, 2): 0.990909090909091}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004545454545454545, (1, 1): 0.004545454545454545, (1, 2): 0.990909090909091}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 218.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=220.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004545454545454545, (2, 1): 0.990909090909091, (2, 2): 0.004545454545454545}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004545454545454545, (2, 1): 0.990909090909091, (2, 2): 0.004545454545454545}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 218.0 -> 219.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 218.0 -> 219.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 120.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=131.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.06870229007633588, (2, 1): 0.916030534351145, (2, 2): 0.015267175572519083}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.06870229007633588, (2, 1): 0.916030534351145, (2, 2): 0.015267175572519083}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 120.0}
in get_filtered_urn(filter=1) --- total: total=132.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.07575757575757576, (1, 1): 0.015151515151515152, (1, 2): 0.9090909090909091}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.07575757575757576, (1, 1): 0.015151515151515152, (1, 2): 0.9090909090909091}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 120.0 -> 121.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 120.0 -> 121.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 154.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=159.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9685534591194969, (2, 1): 0.025157232704402517, (2, 2): 0.006289308176100629}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9685534591194969, (2, 1): 0.025157232704402517, (2, 2): 0.006289308176100629}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 154.0}
in get_filtered_urn(filter=0) --- total: total=156.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00641025641025641, (0, 1): 0.00641025641025641, (0, 2): 0.9871794871794872}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00641025641025641, (0, 1): 0.00641025641025641, (0, 2): 0.9871794871794872}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 154.0 -> 155.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 154.0 -> 155.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 121.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=132.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.06818181818181818, (2, 1): 0.9166666666666666, (2, 2): 0.015151515151515152}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.06818181818181818, (2, 1): 0.9166666666666666, (2, 2): 0.015151515151515152}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 121.0}
in get_filtered_urn(filter=1) --- total: total=133.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.07518796992481203, (1, 1): 0.015037593984962405, (1, 2): 0.9097744360902256}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.07518796992481203, (1, 1): 0.015037593984962405, (1, 2): 0.9097744360902256}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 121.0 -> 122.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 121.0 -> 122.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 219.0}
in get_filtered_urn(filter=1) --- total: total=221.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004524886877828055, (1, 1): 0.004524886877828055, (1, 2): 0.9909502262443439}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004524886877828055, (1, 1): 0.004524886877828055, (1, 2): 0.9909502262443439}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 219.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=221.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004524886877828055, (2, 1): 0.9909502262443439, (2, 2): 0.004524886877828055}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004524886877828055, (2, 1): 0.9909502262443439, (2, 2): 0.004524886877828055}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 219.0 -> 220.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 219.0 -> 220.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 122.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=133.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.06766917293233082, (2, 1): 0.9172932330827067, (2, 2): 0.015037593984962405}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.06766917293233082, (2, 1): 0.9172932330827067, (2, 2): 0.015037593984962405}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 122.0}
in get_filtered_urn(filter=1) --- total: total=134.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.07462686567164178, (1, 1): 0.014925373134328358, (1, 2): 0.9104477611940298}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.07462686567164178, (1, 1): 0.014925373134328358, (1, 2): 0.9104477611940298}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 122.0 -> 123.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 122.0 -> 123.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 181.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=183.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00546448087431694, (0, 1): 0.9890710382513661, (0, 2): 0.00546448087431694}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00546448087431694, (0, 1): 0.9890710382513661, (0, 2): 0.00546448087431694}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 181.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=186.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9731182795698925, (1, 1): 0.005376344086021506, (1, 2): 0.021505376344086023}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9731182795698925, (1, 1): 0.005376344086021506, (1, 2): 0.021505376344086023}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 181.0 -> 182.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 181.0 -> 182.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 137.0}
in get_filtered_urn(filter=0) --- total: total=149.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013422818791946308, (0, 1): 0.06711409395973154, (0, 2): 0.9194630872483222}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.013422818791946308, (0, 1): 0.06711409395973154, (0, 2): 0.9194630872483222}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 137.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=143.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.958041958041958, (2, 1): 0.027972027972027972, (2, 2): 0.013986013986013986}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.958041958041958, (2, 1): 0.027972027972027972, (2, 2): 0.013986013986013986}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 137.0 -> 138.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 137.0 -> 138.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 182.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=184.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005434782608695652, (0, 1): 0.9891304347826086, (0, 2): 0.005434782608695652}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005434782608695652, (0, 1): 0.9891304347826086, (0, 2): 0.005434782608695652}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 182.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=187.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9732620320855615, (1, 1): 0.0053475935828877, (1, 2): 0.0213903743315508}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9732620320855615, (1, 1): 0.0053475935828877, (1, 2): 0.0213903743315508}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 182.0 -> 183.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 182.0 -> 183.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 123.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=134.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.06716417910447761, (2, 1): 0.917910447761194, (2, 2): 0.014925373134328358}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.06716417910447761, (2, 1): 0.917910447761194, (2, 2): 0.014925373134328358}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 123.0}
in get_filtered_urn(filter=1) --- total: total=135.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.07407407407407407, (1, 1): 0.014814814814814815, (1, 2): 0.9111111111111111}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.07407407407407407, (1, 1): 0.014814814814814815, (1, 2): 0.9111111111111111}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 123.0 -> 124.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 123.0 -> 124.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 220.0}
in get_filtered_urn(filter=1) --- total: total=222.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0045045045045045045, (1, 1): 0.0045045045045045045, (1, 2): 0.990990990990991}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0045045045045045045, (1, 1): 0.0045045045045045045, (1, 2): 0.990990990990991}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 220.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=222.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0045045045045045045, (2, 1): 0.990990990990991, (2, 2): 0.0045045045045045045}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0045045045045045045, (2, 1): 0.990990990990991, (2, 2): 0.0045045045045045045}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 220.0 -> 221.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 220.0 -> 221.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 138.0}
in get_filtered_urn(filter=0) --- total: total=150.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013333333333333334, (0, 1): 0.06666666666666667, (0, 2): 0.92}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.013333333333333334, (0, 1): 0.06666666666666667, (0, 2): 0.92}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 138.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=144.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9583333333333334, (2, 1): 0.027777777777777776, (2, 2): 0.013888888888888888}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9583333333333334, (2, 1): 0.027777777777777776, (2, 2): 0.013888888888888888}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 138.0 -> 139.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 138.0 -> 139.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 221.0}
in get_filtered_urn(filter=1) --- total: total=223.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004484304932735426, (1, 1): 0.004484304932735426, (1, 2): 0.9910313901345291}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004484304932735426, (1, 1): 0.004484304932735426, (1, 2): 0.9910313901345291}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 221.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=223.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004484304932735426, (2, 1): 0.9910313901345291, (2, 2): 0.004484304932735426}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004484304932735426, (2, 1): 0.9910313901345291, (2, 2): 0.004484304932735426}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 221.0 -> 222.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 221.0 -> 222.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 124.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=135.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.06666666666666667, (2, 1): 0.9185185185185185, (2, 2): 0.014814814814814815}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.06666666666666667, (2, 1): 0.9185185185185185, (2, 2): 0.014814814814814815}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 124.0}
in get_filtered_urn(filter=1) --- total: total=136.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.07352941176470588, (1, 1): 0.014705882352941176, (1, 2): 0.9117647058823529}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.07352941176470588, (1, 1): 0.014705882352941176, (1, 2): 0.9117647058823529}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 124.0 -> 125.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 124.0 -> 125.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 222.0}
in get_filtered_urn(filter=1) --- total: total=224.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004464285714285714, (1, 1): 0.004464285714285714, (1, 2): 0.9910714285714286}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004464285714285714, (1, 1): 0.004464285714285714, (1, 2): 0.9910714285714286}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 222.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=224.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004464285714285714, (2, 1): 0.9910714285714286, (2, 2): 0.004464285714285714}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004464285714285714, (2, 1): 0.9910714285714286, (2, 2): 0.004464285714285714}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 222.0 -> 223.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 222.0 -> 223.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 139.0}
in get_filtered_urn(filter=0) --- total: total=151.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013245033112582781, (0, 1): 0.06622516556291391, (0, 2): 0.9205298013245033}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.013245033112582781, (0, 1): 0.06622516556291391, (0, 2): 0.9205298013245033}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 139.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=145.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9586206896551724, (2, 1): 0.027586206896551724, (2, 2): 0.013793103448275862}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9586206896551724, (2, 1): 0.027586206896551724, (2, 2): 0.013793103448275862}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 139.0 -> 140.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 139.0 -> 140.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 155.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=160.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.96875, (2, 1): 0.025, (2, 2): 0.00625}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.96875, (2, 1): 0.025, (2, 2): 0.00625}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 155.0}
in get_filtered_urn(filter=0) --- total: total=157.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006369426751592357, (0, 1): 0.006369426751592357, (0, 2): 0.9872611464968153}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.006369426751592357, (0, 1): 0.006369426751592357, (0, 2): 0.9872611464968153}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 155.0 -> 156.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 155.0 -> 156.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 125.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=136.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0661764705882353, (2, 1): 0.9191176470588235, (2, 2): 0.014705882352941176}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0661764705882353, (2, 1): 0.9191176470588235, (2, 2): 0.014705882352941176}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 125.0}
in get_filtered_urn(filter=1) --- total: total=137.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.072992700729927, (1, 1): 0.014598540145985401, (1, 2): 0.9124087591240876}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.072992700729927, (1, 1): 0.014598540145985401, (1, 2): 0.9124087591240876}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 125.0 -> 126.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 125.0 -> 126.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 183.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=185.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005405405405405406, (0, 1): 0.9891891891891892, (0, 2): 0.005405405405405406}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005405405405405406, (0, 1): 0.9891891891891892, (0, 2): 0.005405405405405406}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 183.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=188.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.973404255319149, (1, 1): 0.005319148936170213, (1, 2): 0.02127659574468085}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.973404255319149, (1, 1): 0.005319148936170213, (1, 2): 0.02127659574468085}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 183.0 -> 184.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 183.0 -> 184.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 126.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=137.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.06569343065693431, (2, 1): 0.9197080291970803, (2, 2): 0.014598540145985401}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.06569343065693431, (2, 1): 0.9197080291970803, (2, 2): 0.014598540145985401}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 126.0}
in get_filtered_urn(filter=1) --- total: total=138.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.07246376811594203, (1, 1): 0.014492753623188406, (1, 2): 0.9130434782608695}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.07246376811594203, (1, 1): 0.014492753623188406, (1, 2): 0.9130434782608695}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 126.0 -> 127.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 126.0 -> 127.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 184.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=186.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005376344086021506, (0, 1): 0.989247311827957, (0, 2): 0.005376344086021506}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005376344086021506, (0, 1): 0.989247311827957, (0, 2): 0.005376344086021506}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 184.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=189.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9735449735449735, (1, 1): 0.005291005291005291, (1, 2): 0.021164021164021163}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9735449735449735, (1, 1): 0.005291005291005291, (1, 2): 0.021164021164021163}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 184.0 -> 185.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 184.0 -> 185.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 127.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=138.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.06521739130434782, (2, 1): 0.9202898550724637, (2, 2): 0.014492753623188406}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.06521739130434782, (2, 1): 0.9202898550724637, (2, 2): 0.014492753623188406}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 127.0}
in get_filtered_urn(filter=1) --- total: total=139.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.07194244604316546, (1, 1): 0.014388489208633094, (1, 2): 0.9136690647482014}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.07194244604316546, (1, 1): 0.014388489208633094, (1, 2): 0.9136690647482014}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 127.0 -> 128.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 127.0 -> 128.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 185.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=187.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0053475935828877, (0, 1): 0.9893048128342246, (0, 2): 0.0053475935828877}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0053475935828877, (0, 1): 0.9893048128342246, (0, 2): 0.0053475935828877}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 185.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=190.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9736842105263158, (1, 1): 0.005263157894736842, (1, 2): 0.021052631578947368}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9736842105263158, (1, 1): 0.005263157894736842, (1, 2): 0.021052631578947368}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 185.0 -> 186.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 185.0 -> 186.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 148.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=154.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.961038961038961, (1, 1): 0.012987012987012988, (1, 2): 0.025974025974025976}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.961038961038961, (1, 1): 0.012987012987012988, (1, 2): 0.025974025974025976}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 148.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=159.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012578616352201259, (0, 1): 0.9308176100628931, (0, 2): 0.05660377358490566}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.012578616352201259, (0, 1): 0.9308176100628931, (0, 2): 0.05660377358490566}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 148.0 -> 149.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 148.0 -> 149.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 186.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=188.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005319148936170213, (0, 1): 0.9893617021276596, (0, 2): 0.005319148936170213}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005319148936170213, (0, 1): 0.9893617021276596, (0, 2): 0.005319148936170213}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 186.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=191.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9738219895287958, (1, 1): 0.005235602094240838, (1, 2): 0.020942408376963352}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9738219895287958, (1, 1): 0.005235602094240838, (1, 2): 0.020942408376963352}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 186.0 -> 187.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 186.0 -> 187.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 128.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=139.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.06474820143884892, (2, 1): 0.920863309352518, (2, 2): 0.014388489208633094}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.06474820143884892, (2, 1): 0.920863309352518, (2, 2): 0.014388489208633094}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 128.0}
in get_filtered_urn(filter=1) --- total: total=140.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.07142857142857142, (1, 1): 0.014285714285714285, (1, 2): 0.9142857142857143}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.07142857142857142, (1, 1): 0.014285714285714285, (1, 2): 0.9142857142857143}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 128.0 -> 129.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 128.0 -> 129.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 187.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=189.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005291005291005291, (0, 1): 0.9894179894179894, (0, 2): 0.005291005291005291}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005291005291005291, (0, 1): 0.9894179894179894, (0, 2): 0.005291005291005291}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 187.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=192.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9739583333333334, (1, 1): 0.005208333333333333, (1, 2): 0.020833333333333332}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9739583333333334, (1, 1): 0.005208333333333333, (1, 2): 0.020833333333333332}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 187.0 -> 188.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 187.0 -> 188.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 149.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=155.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9612903225806452, (1, 1): 0.012903225806451613, (1, 2): 0.025806451612903226}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9612903225806452, (1, 1): 0.012903225806451613, (1, 2): 0.025806451612903226}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 149.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=160.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0125, (0, 1): 0.93125, (0, 2): 0.05625}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0125, (0, 1): 0.93125, (0, 2): 0.05625}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 149.0 -> 150.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 149.0 -> 150.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 188.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=190.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005263157894736842, (0, 1): 0.9894736842105263, (0, 2): 0.005263157894736842}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005263157894736842, (0, 1): 0.9894736842105263, (0, 2): 0.005263157894736842}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 188.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=193.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9740932642487047, (1, 1): 0.0051813471502590676, (1, 2): 0.02072538860103627}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9740932642487047, (1, 1): 0.0051813471502590676, (1, 2): 0.02072538860103627}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 188.0 -> 189.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 188.0 -> 189.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 150.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=156.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9615384615384616, (1, 1): 0.01282051282051282, (1, 2): 0.02564102564102564}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9615384615384616, (1, 1): 0.01282051282051282, (1, 2): 0.02564102564102564}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 150.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=161.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012422360248447204, (0, 1): 0.9316770186335404, (0, 2): 0.055900621118012424}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.012422360248447204, (0, 1): 0.9316770186335404, (0, 2): 0.055900621118012424}
in decode_message(signal=0) Receiver 5 got option: (0, 0) and decoded action: 0
Receiver 5 received signals: [0] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 150.0 -> 150.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 0): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 189.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=191.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005235602094240838, (0, 1): 0.9895287958115183, (0, 2): 0.005235602094240838}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005235602094240838, (0, 1): 0.9895287958115183, (0, 2): 0.005235602094240838}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 189.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=194.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9742268041237113, (1, 1): 0.005154639175257732, (1, 2): 0.020618556701030927}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9742268041237113, (1, 1): 0.005154639175257732, (1, 2): 0.020618556701030927}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 189.0 -> 190.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 189.0 -> 190.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 140.0}
in get_filtered_urn(filter=0) --- total: total=152.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013157894736842105, (0, 1): 0.06578947368421052, (0, 2): 0.9210526315789473}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.013157894736842105, (0, 1): 0.06578947368421052, (0, 2): 0.9210526315789473}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 140.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=146.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.958904109589041, (2, 1): 0.0273972602739726, (2, 2): 0.0136986301369863}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.958904109589041, (2, 1): 0.0273972602739726, (2, 2): 0.0136986301369863}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 140.0 -> 141.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 140.0 -> 141.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 190.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=192.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005208333333333333, (0, 1): 0.9895833333333334, (0, 2): 0.005208333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005208333333333333, (0, 1): 0.9895833333333334, (0, 2): 0.005208333333333333}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 190.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=195.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9743589743589743, (1, 1): 0.005128205128205128, (1, 2): 0.020512820512820513}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9743589743589743, (1, 1): 0.005128205128205128, (1, 2): 0.020512820512820513}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 190.0 -> 191.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 190.0 -> 191.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 150.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=156.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9615384615384616, (1, 1): 0.01282051282051282, (1, 2): 0.02564102564102564}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9615384615384616, (1, 1): 0.01282051282051282, (1, 2): 0.02564102564102564}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 150.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=161.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012422360248447204, (0, 1): 0.9316770186335404, (0, 2): 0.055900621118012424}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.012422360248447204, (0, 1): 0.9316770186335404, (0, 2): 0.055900621118012424}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 150.0 -> 151.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 150.0 -> 151.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 223.0}
in get_filtered_urn(filter=1) --- total: total=225.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0044444444444444444, (1, 1): 0.0044444444444444444, (1, 2): 0.9911111111111112}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0044444444444444444, (1, 1): 0.0044444444444444444, (1, 2): 0.9911111111111112}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 223.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=225.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0044444444444444444, (2, 1): 0.9911111111111112, (2, 2): 0.0044444444444444444}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0044444444444444444, (2, 1): 0.9911111111111112, (2, 2): 0.0044444444444444444}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 223.0 -> 224.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 223.0 -> 224.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 129.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=140.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.06428571428571428, (2, 1): 0.9214285714285714, (2, 2): 0.014285714285714285}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.06428571428571428, (2, 1): 0.9214285714285714, (2, 2): 0.014285714285714285}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 129.0}
in get_filtered_urn(filter=1) --- total: total=141.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.07092198581560284, (1, 1): 0.014184397163120567, (1, 2): 0.9148936170212766}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.07092198581560284, (1, 1): 0.014184397163120567, (1, 2): 0.9148936170212766}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 129.0 -> 130.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 129.0 -> 130.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 191.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=193.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0051813471502590676, (0, 1): 0.9896373056994818, (0, 2): 0.0051813471502590676}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0051813471502590676, (0, 1): 0.9896373056994818, (0, 2): 0.0051813471502590676}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 191.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=196.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9744897959183674, (1, 1): 0.00510204081632653, (1, 2): 0.02040816326530612}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9744897959183674, (1, 1): 0.00510204081632653, (1, 2): 0.02040816326530612}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 191.0 -> 192.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 191.0 -> 192.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 141.0}
in get_filtered_urn(filter=0) --- total: total=153.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013071895424836602, (0, 1): 0.06535947712418301, (0, 2): 0.9215686274509803}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.013071895424836602, (0, 1): 0.06535947712418301, (0, 2): 0.9215686274509803}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 141.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=147.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9591836734693877, (2, 1): 0.027210884353741496, (2, 2): 0.013605442176870748}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.9591836734693877, (2, 1): 0.027210884353741496, (2, 2): 0.013605442176870748}
in decode_message(signal=2) Receiver 5 got option: (2, 2) and decoded action: 2
Receiver 5 received signals: [2] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 2): 141.0 -> 141.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 192.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=194.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005154639175257732, (0, 1): 0.9896907216494846, (0, 2): 0.005154639175257732}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005154639175257732, (0, 1): 0.9896907216494846, (0, 2): 0.005154639175257732}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 192.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=197.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9746192893401016, (1, 1): 0.005076142131979695, (1, 2): 0.02030456852791878}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9746192893401016, (1, 1): 0.005076142131979695, (1, 2): 0.02030456852791878}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 192.0 -> 193.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 192.0 -> 193.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 130.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=141.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.06382978723404255, (2, 1): 0.9219858156028369, (2, 2): 0.014184397163120567}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.06382978723404255, (2, 1): 0.9219858156028369, (2, 2): 0.014184397163120567}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 130.0}
in get_filtered_urn(filter=1) --- total: total=142.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.07042253521126761, (1, 1): 0.014084507042253521, (1, 2): 0.9154929577464789}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.07042253521126761, (1, 1): 0.014084507042253521, (1, 2): 0.9154929577464789}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 130.0 -> 131.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 130.0 -> 131.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 193.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=195.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005128205128205128, (0, 1): 0.9897435897435898, (0, 2): 0.005128205128205128}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005128205128205128, (0, 1): 0.9897435897435898, (0, 2): 0.005128205128205128}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 193.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=198.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9747474747474747, (1, 1): 0.005050505050505051, (1, 2): 0.020202020202020204}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9747474747474747, (1, 1): 0.005050505050505051, (1, 2): 0.020202020202020204}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 193.0 -> 194.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 193.0 -> 194.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 141.0}
in get_filtered_urn(filter=0) --- total: total=153.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.013071895424836602, (0, 1): 0.06535947712418301, (0, 2): 0.9215686274509803}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.013071895424836602, (0, 1): 0.06535947712418301, (0, 2): 0.9215686274509803}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 141.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=147.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9591836734693877, (2, 1): 0.027210884353741496, (2, 2): 0.013605442176870748}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9591836734693877, (2, 1): 0.027210884353741496, (2, 2): 0.013605442176870748}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 141.0 -> 142.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 141.0 -> 142.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 224.0}
in get_filtered_urn(filter=1) --- total: total=226.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004424778761061947, (1, 1): 0.004424778761061947, (1, 2): 0.9911504424778761}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004424778761061947, (1, 1): 0.004424778761061947, (1, 2): 0.9911504424778761}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 224.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=226.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004424778761061947, (2, 1): 0.9911504424778761, (2, 2): 0.004424778761061947}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004424778761061947, (2, 1): 0.9911504424778761, (2, 2): 0.004424778761061947}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 224.0 -> 225.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 224.0 -> 225.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 151.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=157.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9617834394904459, (1, 1): 0.012738853503184714, (1, 2): 0.025477707006369428}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.9617834394904459, (1, 1): 0.012738853503184714, (1, 2): 0.025477707006369428}
Sender 4 got filter 1 choose option: (1, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 131.0}
in get_filtered_urn(filter=1) --- total: total=143.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06993006993006994, (1, 1): 0.013986013986013986, (1, 2): 0.916083916083916}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06993006993006994, (1, 1): 0.013986013986013986, (1, 2): 0.916083916083916}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 1): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 131.0 -> 131.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 156.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=161.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.968944099378882, (2, 1): 0.024844720496894408, (2, 2): 0.006211180124223602}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.968944099378882, (2, 1): 0.024844720496894408, (2, 2): 0.006211180124223602}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 156.0}
in get_filtered_urn(filter=0) --- total: total=158.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006329113924050633, (0, 1): 0.006329113924050633, (0, 2): 0.9873417721518988}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.006329113924050633, (0, 1): 0.006329113924050633, (0, 2): 0.9873417721518988}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 156.0 -> 157.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 156.0 -> 157.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 151.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=157.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9617834394904459, (1, 1): 0.012738853503184714, (1, 2): 0.025477707006369428}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9617834394904459, (1, 1): 0.012738853503184714, (1, 2): 0.025477707006369428}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 151.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=162.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012345679012345678, (0, 1): 0.9320987654320988, (0, 2): 0.05555555555555555}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.012345679012345678, (0, 1): 0.9320987654320988, (0, 2): 0.05555555555555555}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 151.0 -> 152.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 151.0 -> 152.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 194.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=196.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00510204081632653, (0, 1): 0.9897959183673469, (0, 2): 0.00510204081632653}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00510204081632653, (0, 1): 0.9897959183673469, (0, 2): 0.00510204081632653}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 194.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=199.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9748743718592965, (1, 1): 0.005025125628140704, (1, 2): 0.020100502512562814}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9748743718592965, (1, 1): 0.005025125628140704, (1, 2): 0.020100502512562814}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 194.0 -> 195.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 194.0 -> 195.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 131.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=142.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.06338028169014084, (2, 1): 0.9225352112676056, (2, 2): 0.014084507042253521}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.06338028169014084, (2, 1): 0.9225352112676056, (2, 2): 0.014084507042253521}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 131.0}
in get_filtered_urn(filter=1) --- total: total=143.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06993006993006994, (1, 1): 0.013986013986013986, (1, 2): 0.916083916083916}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06993006993006994, (1, 1): 0.013986013986013986, (1, 2): 0.916083916083916}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 131.0 -> 132.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 131.0 -> 132.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 195.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=197.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005076142131979695, (0, 1): 0.9898477157360406, (0, 2): 0.005076142131979695}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005076142131979695, (0, 1): 0.9898477157360406, (0, 2): 0.005076142131979695}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 195.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=200.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.975, (1, 1): 0.005, (1, 2): 0.02}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.975, (1, 1): 0.005, (1, 2): 0.02}
in decode_message(signal=1) Receiver 2 got option: (1, 2) and decoded action: 2
Receiver 2 received signals: [1] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 1): 195.0 -> 195.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 152.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=158.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9620253164556962, (1, 1): 0.012658227848101266, (1, 2): 0.02531645569620253}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9620253164556962, (1, 1): 0.012658227848101266, (1, 2): 0.02531645569620253}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 152.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=163.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012269938650306749, (0, 1): 0.9325153374233128, (0, 2): 0.05521472392638037}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.012269938650306749, (0, 1): 0.9325153374233128, (0, 2): 0.05521472392638037}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 152.0 -> 153.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 152.0 -> 153.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 157.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=162.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9691358024691358, (2, 1): 0.024691358024691357, (2, 2): 0.006172839506172839}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9691358024691358, (2, 1): 0.024691358024691357, (2, 2): 0.006172839506172839}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 157.0}
in get_filtered_urn(filter=0) --- total: total=159.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006289308176100629, (0, 1): 0.006289308176100629, (0, 2): 0.9874213836477987}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.006289308176100629, (0, 1): 0.006289308176100629, (0, 2): 0.9874213836477987}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 157.0 -> 158.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 157.0 -> 158.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 132.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=143.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.06293706293706294, (2, 1): 0.9230769230769231, (2, 2): 0.013986013986013986}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.06293706293706294, (2, 1): 0.9230769230769231, (2, 2): 0.013986013986013986}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 132.0}
in get_filtered_urn(filter=1) --- total: total=144.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06944444444444445, (1, 1): 0.013888888888888888, (1, 2): 0.9166666666666666}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06944444444444445, (1, 1): 0.013888888888888888, (1, 2): 0.9166666666666666}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 132.0 -> 133.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 132.0 -> 133.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 195.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=197.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005076142131979695, (0, 1): 0.9898477157360406, (0, 2): 0.005076142131979695}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005076142131979695, (0, 1): 0.9898477157360406, (0, 2): 0.005076142131979695}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 195.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=200.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.975, (1, 1): 0.005, (1, 2): 0.02}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.975, (1, 1): 0.005, (1, 2): 0.02}
in decode_message(signal=1) Receiver 2 got option: (1, 2) and decoded action: 2
Receiver 2 received signals: [1] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 1): 195.0 -> 195.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 142.0}
in get_filtered_urn(filter=0) --- total: total=154.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012987012987012988, (0, 1): 0.06493506493506493, (0, 2): 0.922077922077922}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.012987012987012988, (0, 1): 0.06493506493506493, (0, 2): 0.922077922077922}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 142.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=148.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9594594594594594, (2, 1): 0.02702702702702703, (2, 2): 0.013513513513513514}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9594594594594594, (2, 1): 0.02702702702702703, (2, 2): 0.013513513513513514}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 142.0 -> 143.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 142.0 -> 143.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 158.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=163.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9693251533742331, (2, 1): 0.024539877300613498, (2, 2): 0.006134969325153374}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9693251533742331, (2, 1): 0.024539877300613498, (2, 2): 0.006134969325153374}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 158.0}
in get_filtered_urn(filter=0) --- total: total=160.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00625, (0, 1): 0.00625, (0, 2): 0.9875}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00625, (0, 1): 0.00625, (0, 2): 0.9875}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 158.0 -> 159.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 158.0 -> 159.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 133.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=144.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0625, (2, 1): 0.9236111111111112, (2, 2): 0.013888888888888888}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0625, (2, 1): 0.9236111111111112, (2, 2): 0.013888888888888888}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 133.0}
in get_filtered_urn(filter=1) --- total: total=145.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06896551724137931, (1, 1): 0.013793103448275862, (1, 2): 0.9172413793103448}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06896551724137931, (1, 1): 0.013793103448275862, (1, 2): 0.9172413793103448}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 133.0 -> 134.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 133.0 -> 134.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 195.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=197.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005076142131979695, (0, 1): 0.9898477157360406, (0, 2): 0.005076142131979695}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005076142131979695, (0, 1): 0.9898477157360406, (0, 2): 0.005076142131979695}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 195.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=200.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.975, (1, 1): 0.005, (1, 2): 0.02}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.975, (1, 1): 0.005, (1, 2): 0.02}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 195.0 -> 196.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 195.0 -> 196.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 143.0}
in get_filtered_urn(filter=0) --- total: total=155.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012903225806451613, (0, 1): 0.06451612903225806, (0, 2): 0.9225806451612903}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.012903225806451613, (0, 1): 0.06451612903225806, (0, 2): 0.9225806451612903}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 143.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=149.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.959731543624161, (2, 1): 0.026845637583892617, (2, 2): 0.013422818791946308}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.959731543624161, (2, 1): 0.026845637583892617, (2, 2): 0.013422818791946308}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 143.0 -> 144.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 143.0 -> 144.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 225.0}
in get_filtered_urn(filter=1) --- total: total=227.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004405286343612335, (1, 1): 0.004405286343612335, (1, 2): 0.9911894273127754}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004405286343612335, (1, 1): 0.004405286343612335, (1, 2): 0.9911894273127754}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 225.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=227.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004405286343612335, (2, 1): 0.9911894273127754, (2, 2): 0.004405286343612335}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004405286343612335, (2, 1): 0.9911894273127754, (2, 2): 0.004405286343612335}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 225.0 -> 226.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 225.0 -> 226.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 144.0}
in get_filtered_urn(filter=0) --- total: total=156.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01282051282051282, (0, 1): 0.0641025641025641, (0, 2): 0.9230769230769231}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.01282051282051282, (0, 1): 0.0641025641025641, (0, 2): 0.9230769230769231}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 144.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=150.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.96, (2, 1): 0.02666666666666667, (2, 2): 0.013333333333333334}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.96, (2, 1): 0.02666666666666667, (2, 2): 0.013333333333333334}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 144.0 -> 145.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 144.0 -> 145.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 196.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=198.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005050505050505051, (0, 1): 0.98989898989899, (0, 2): 0.005050505050505051}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005050505050505051, (0, 1): 0.98989898989899, (0, 2): 0.005050505050505051}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 196.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=201.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9751243781094527, (1, 1): 0.004975124378109453, (1, 2): 0.01990049751243781}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9751243781094527, (1, 1): 0.004975124378109453, (1, 2): 0.01990049751243781}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 196.0 -> 197.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 196.0 -> 197.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 153.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=159.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9622641509433962, (1, 1): 0.012578616352201259, (1, 2): 0.025157232704402517}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9622641509433962, (1, 1): 0.012578616352201259, (1, 2): 0.025157232704402517}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 153.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=164.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012195121951219513, (0, 1): 0.9329268292682927, (0, 2): 0.054878048780487805}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.012195121951219513, (0, 1): 0.9329268292682927, (0, 2): 0.054878048780487805}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 153.0 -> 154.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 153.0 -> 154.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 226.0}
in get_filtered_urn(filter=1) --- total: total=228.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0043859649122807015, (1, 1): 0.0043859649122807015, (1, 2): 0.9912280701754386}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0043859649122807015, (1, 1): 0.0043859649122807015, (1, 2): 0.9912280701754386}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 226.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=228.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0043859649122807015, (2, 1): 0.9912280701754386, (2, 2): 0.0043859649122807015}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0043859649122807015, (2, 1): 0.9912280701754386, (2, 2): 0.0043859649122807015}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 226.0 -> 227.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 226.0 -> 227.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 145.0}
in get_filtered_urn(filter=0) --- total: total=157.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012738853503184714, (0, 1): 0.06369426751592357, (0, 2): 0.9235668789808917}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.012738853503184714, (0, 1): 0.06369426751592357, (0, 2): 0.9235668789808917}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 145.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=151.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9602649006622517, (2, 1): 0.026490066225165563, (2, 2): 0.013245033112582781}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9602649006622517, (2, 1): 0.026490066225165563, (2, 2): 0.013245033112582781}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 145.0 -> 146.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 145.0 -> 146.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 227.0}
in get_filtered_urn(filter=1) --- total: total=229.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004366812227074236, (1, 1): 0.004366812227074236, (1, 2): 0.9912663755458515}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004366812227074236, (1, 1): 0.004366812227074236, (1, 2): 0.9912663755458515}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 227.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=229.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004366812227074236, (2, 1): 0.9912663755458515, (2, 2): 0.004366812227074236}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004366812227074236, (2, 1): 0.9912663755458515, (2, 2): 0.004366812227074236}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 227.0 -> 228.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 227.0 -> 228.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 146.0}
in get_filtered_urn(filter=0) --- total: total=158.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012658227848101266, (0, 1): 0.06329113924050633, (0, 2): 0.9240506329113924}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.012658227848101266, (0, 1): 0.06329113924050633, (0, 2): 0.9240506329113924}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 146.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=152.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9605263157894737, (2, 1): 0.02631578947368421, (2, 2): 0.013157894736842105}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9605263157894737, (2, 1): 0.02631578947368421, (2, 2): 0.013157894736842105}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 146.0 -> 147.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 146.0 -> 147.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 228.0}
in get_filtered_urn(filter=1) --- total: total=230.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004347826086956522, (1, 1): 0.004347826086956522, (1, 2): 0.991304347826087}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004347826086956522, (1, 1): 0.004347826086956522, (1, 2): 0.991304347826087}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 228.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=230.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004347826086956522, (2, 1): 0.991304347826087, (2, 2): 0.004347826086956522}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004347826086956522, (2, 1): 0.991304347826087, (2, 2): 0.004347826086956522}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 228.0 -> 229.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 228.0 -> 229.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 154.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=160.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9625, (1, 1): 0.0125, (1, 2): 0.025}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9625, (1, 1): 0.0125, (1, 2): 0.025}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 154.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=165.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012121212121212121, (0, 1): 0.9333333333333333, (0, 2): 0.05454545454545454}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.012121212121212121, (0, 1): 0.9333333333333333, (0, 2): 0.05454545454545454}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 154.0 -> 155.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 154.0 -> 155.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 229.0}
in get_filtered_urn(filter=1) --- total: total=231.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004329004329004329, (1, 1): 0.004329004329004329, (1, 2): 0.9913419913419913}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004329004329004329, (1, 1): 0.004329004329004329, (1, 2): 0.9913419913419913}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 229.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=231.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004329004329004329, (2, 1): 0.9913419913419913, (2, 2): 0.004329004329004329}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004329004329004329, (2, 1): 0.9913419913419913, (2, 2): 0.004329004329004329}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 229.0 -> 230.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 229.0 -> 230.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 147.0}
in get_filtered_urn(filter=0) --- total: total=159.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012578616352201259, (0, 1): 0.06289308176100629, (0, 2): 0.9245283018867925}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.012578616352201259, (0, 1): 0.06289308176100629, (0, 2): 0.9245283018867925}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 147.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=153.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9607843137254902, (2, 1): 0.026143790849673203, (2, 2): 0.013071895424836602}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9607843137254902, (2, 1): 0.026143790849673203, (2, 2): 0.013071895424836602}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 147.0 -> 148.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 147.0 -> 148.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 159.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=164.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9695121951219512, (2, 1): 0.024390243902439025, (2, 2): 0.006097560975609756}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9695121951219512, (2, 1): 0.024390243902439025, (2, 2): 0.006097560975609756}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 159.0}
in get_filtered_urn(filter=0) --- total: total=161.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006211180124223602, (0, 1): 0.006211180124223602, (0, 2): 0.9875776397515528}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.006211180124223602, (0, 1): 0.006211180124223602, (0, 2): 0.9875776397515528}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 159.0 -> 160.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 159.0 -> 160.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 155.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=161.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9627329192546584, (1, 1): 0.012422360248447204, (1, 2): 0.024844720496894408}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.9627329192546584, (1, 1): 0.012422360248447204, (1, 2): 0.024844720496894408}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 148.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=154.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.961038961038961, (2, 1): 0.025974025974025976, (2, 2): 0.012987012987012988}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.961038961038961, (2, 1): 0.025974025974025976, (2, 2): 0.012987012987012988}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 148.0 -> 148.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 230.0}
in get_filtered_urn(filter=1) --- total: total=232.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004310344827586207, (1, 1): 0.004310344827586207, (1, 2): 0.9913793103448276}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004310344827586207, (1, 1): 0.004310344827586207, (1, 2): 0.9913793103448276}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 230.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=232.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004310344827586207, (2, 1): 0.9913793103448276, (2, 2): 0.004310344827586207}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004310344827586207, (2, 1): 0.9913793103448276, (2, 2): 0.004310344827586207}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 230.0 -> 231.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 230.0 -> 231.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 155.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=161.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9627329192546584, (1, 1): 0.012422360248447204, (1, 2): 0.024844720496894408}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9627329192546584, (1, 1): 0.012422360248447204, (1, 2): 0.024844720496894408}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 155.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=166.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012048192771084338, (0, 1): 0.9337349397590361, (0, 2): 0.05421686746987952}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.012048192771084338, (0, 1): 0.9337349397590361, (0, 2): 0.05421686746987952}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 155.0 -> 156.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 155.0 -> 156.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 197.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=199.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005025125628140704, (0, 1): 0.9899497487437185, (0, 2): 0.005025125628140704}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005025125628140704, (0, 1): 0.9899497487437185, (0, 2): 0.005025125628140704}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 197.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=202.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9752475247524752, (1, 1): 0.0049504950495049506, (1, 2): 0.019801980198019802}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9752475247524752, (1, 1): 0.0049504950495049506, (1, 2): 0.019801980198019802}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 197.0 -> 198.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 197.0 -> 198.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 148.0}
in get_filtered_urn(filter=0) --- total: total=160.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0125, (0, 1): 0.0625, (0, 2): 0.925}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0125, (0, 1): 0.0625, (0, 2): 0.925}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 148.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=154.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.961038961038961, (2, 1): 0.025974025974025976, (2, 2): 0.012987012987012988}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.961038961038961, (2, 1): 0.025974025974025976, (2, 2): 0.012987012987012988}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 148.0 -> 149.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 148.0 -> 149.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 160.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=165.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9696969696969697, (2, 1): 0.024242424242424242, (2, 2): 0.006060606060606061}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9696969696969697, (2, 1): 0.024242424242424242, (2, 2): 0.006060606060606061}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 160.0}
in get_filtered_urn(filter=0) --- total: total=162.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006172839506172839, (0, 1): 0.006172839506172839, (0, 2): 0.9876543209876543}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.006172839506172839, (0, 1): 0.006172839506172839, (0, 2): 0.9876543209876543}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 160.0 -> 161.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 160.0 -> 161.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 149.0}
in get_filtered_urn(filter=0) --- total: total=161.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012422360248447204, (0, 1): 0.062111801242236024, (0, 2): 0.9254658385093167}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.012422360248447204, (0, 1): 0.062111801242236024, (0, 2): 0.9254658385093167}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 149.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=155.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9612903225806452, (2, 1): 0.025806451612903226, (2, 2): 0.012903225806451613}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9612903225806452, (2, 1): 0.025806451612903226, (2, 2): 0.012903225806451613}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 149.0 -> 150.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 149.0 -> 150.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 161.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=166.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9698795180722891, (2, 1): 0.024096385542168676, (2, 2): 0.006024096385542169}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9698795180722891, (2, 1): 0.024096385542168676, (2, 2): 0.006024096385542169}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 161.0}
in get_filtered_urn(filter=0) --- total: total=163.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006134969325153374, (0, 1): 0.006134969325153374, (0, 2): 0.9877300613496932}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.006134969325153374, (0, 1): 0.006134969325153374, (0, 2): 0.9877300613496932}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 161.0 -> 162.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 161.0 -> 162.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 134.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=145.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.06206896551724138, (2, 1): 0.9241379310344827, (2, 2): 0.013793103448275862}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.06206896551724138, (2, 1): 0.9241379310344827, (2, 2): 0.013793103448275862}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 134.0}
in get_filtered_urn(filter=1) --- total: total=146.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0684931506849315, (1, 1): 0.0136986301369863, (1, 2): 0.9178082191780822}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.0684931506849315, (1, 1): 0.0136986301369863, (1, 2): 0.9178082191780822}
in decode_message(signal=1) Receiver 5 got option: (1, 1) and decoded action: 1
Receiver 5 received signals: [1] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 134.0 -> 134.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 1): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 198.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=200.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005, (0, 1): 0.99, (0, 2): 0.005}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.005, (0, 1): 0.99, (0, 2): 0.005}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 198.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=203.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9753694581280788, (1, 1): 0.0049261083743842365, (1, 2): 0.019704433497536946}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9753694581280788, (1, 1): 0.0049261083743842365, (1, 2): 0.019704433497536946}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 198.0 -> 199.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 198.0 -> 199.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 156.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=162.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9629629629629629, (1, 1): 0.012345679012345678, (1, 2): 0.024691358024691357}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9629629629629629, (1, 1): 0.012345679012345678, (1, 2): 0.024691358024691357}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 156.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=167.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011976047904191617, (0, 1): 0.9341317365269461, (0, 2): 0.05389221556886228}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011976047904191617, (0, 1): 0.9341317365269461, (0, 2): 0.05389221556886228}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 156.0 -> 157.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 156.0 -> 157.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 199.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=201.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004975124378109453, (0, 1): 0.9900497512437811, (0, 2): 0.004975124378109453}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004975124378109453, (0, 1): 0.9900497512437811, (0, 2): 0.004975124378109453}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 199.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=204.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9754901960784313, (1, 1): 0.004901960784313725, (1, 2): 0.0196078431372549}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9754901960784313, (1, 1): 0.004901960784313725, (1, 2): 0.0196078431372549}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 199.0 -> 200.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 199.0 -> 200.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 134.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=145.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.06206896551724138, (2, 1): 0.9241379310344827, (2, 2): 0.013793103448275862}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.06206896551724138, (2, 1): 0.9241379310344827, (2, 2): 0.013793103448275862}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 134.0}
in get_filtered_urn(filter=1) --- total: total=146.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0684931506849315, (1, 1): 0.0136986301369863, (1, 2): 0.9178082191780822}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0684931506849315, (1, 1): 0.0136986301369863, (1, 2): 0.9178082191780822}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 134.0 -> 135.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 134.0 -> 135.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 200.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=202.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0049504950495049506, (0, 1): 0.9900990099009901, (0, 2): 0.0049504950495049506}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0049504950495049506, (0, 1): 0.9900990099009901, (0, 2): 0.0049504950495049506}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 200.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=205.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.975609756097561, (1, 1): 0.004878048780487805, (1, 2): 0.01951219512195122}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.975609756097561, (1, 1): 0.004878048780487805, (1, 2): 0.01951219512195122}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 200.0 -> 201.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 200.0 -> 201.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 135.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=146.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.06164383561643835, (2, 1): 0.9246575342465754, (2, 2): 0.0136986301369863}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.06164383561643835, (2, 1): 0.9246575342465754, (2, 2): 0.0136986301369863}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 135.0}
in get_filtered_urn(filter=1) --- total: total=147.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06802721088435375, (1, 1): 0.013605442176870748, (1, 2): 0.9183673469387755}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06802721088435375, (1, 1): 0.013605442176870748, (1, 2): 0.9183673469387755}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 135.0 -> 136.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 135.0 -> 136.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 231.0}
in get_filtered_urn(filter=1) --- total: total=233.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004291845493562232, (1, 1): 0.004291845493562232, (1, 2): 0.9914163090128756}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004291845493562232, (1, 1): 0.004291845493562232, (1, 2): 0.9914163090128756}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 231.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=233.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004291845493562232, (2, 1): 0.9914163090128756, (2, 2): 0.004291845493562232}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004291845493562232, (2, 1): 0.9914163090128756, (2, 2): 0.004291845493562232}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 231.0 -> 232.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 231.0 -> 232.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 136.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=147.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.061224489795918366, (2, 1): 0.9251700680272109, (2, 2): 0.013605442176870748}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.061224489795918366, (2, 1): 0.9251700680272109, (2, 2): 0.013605442176870748}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 136.0}
in get_filtered_urn(filter=1) --- total: total=148.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06756756756756757, (1, 1): 0.013513513513513514, (1, 2): 0.918918918918919}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.06756756756756757, (1, 1): 0.013513513513513514, (1, 2): 0.918918918918919}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 136.0 -> 136.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 201.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=203.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0049261083743842365, (0, 1): 0.9901477832512315, (0, 2): 0.0049261083743842365}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0049261083743842365, (0, 1): 0.9901477832512315, (0, 2): 0.0049261083743842365}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 201.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=206.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9757281553398058, (1, 1): 0.0048543689320388345, (1, 2): 0.019417475728155338}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9757281553398058, (1, 1): 0.0048543689320388345, (1, 2): 0.019417475728155338}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 201.0 -> 202.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 201.0 -> 202.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 157.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=163.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9631901840490797, (1, 1): 0.012269938650306749, (1, 2): 0.024539877300613498}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9631901840490797, (1, 1): 0.012269938650306749, (1, 2): 0.024539877300613498}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 157.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=168.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011904761904761904, (0, 1): 0.9345238095238095, (0, 2): 0.05357142857142857}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011904761904761904, (0, 1): 0.9345238095238095, (0, 2): 0.05357142857142857}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 157.0 -> 158.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 157.0 -> 158.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 162.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=167.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9700598802395209, (2, 1): 0.023952095808383235, (2, 2): 0.005988023952095809}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9700598802395209, (2, 1): 0.023952095808383235, (2, 2): 0.005988023952095809}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 162.0}
in get_filtered_urn(filter=0) --- total: total=164.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006097560975609756, (0, 1): 0.006097560975609756, (0, 2): 0.9878048780487805}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.006097560975609756, (0, 1): 0.006097560975609756, (0, 2): 0.9878048780487805}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 162.0 -> 163.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 162.0 -> 163.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 136.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=147.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.061224489795918366, (2, 1): 0.9251700680272109, (2, 2): 0.013605442176870748}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.061224489795918366, (2, 1): 0.9251700680272109, (2, 2): 0.013605442176870748}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 136.0}
in get_filtered_urn(filter=1) --- total: total=148.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06756756756756757, (1, 1): 0.013513513513513514, (1, 2): 0.918918918918919}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06756756756756757, (1, 1): 0.013513513513513514, (1, 2): 0.918918918918919}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 136.0 -> 137.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 136.0 -> 137.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 202.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=204.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004901960784313725, (0, 1): 0.9901960784313726, (0, 2): 0.004901960784313725}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004901960784313725, (0, 1): 0.9901960784313726, (0, 2): 0.004901960784313725}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 202.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=207.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9758454106280193, (1, 1): 0.004830917874396135, (1, 2): 0.01932367149758454}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9758454106280193, (1, 1): 0.004830917874396135, (1, 2): 0.01932367149758454}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 202.0 -> 203.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 202.0 -> 203.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 158.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=164.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9634146341463414, (1, 1): 0.012195121951219513, (1, 2): 0.024390243902439025}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.9634146341463414, (1, 1): 0.012195121951219513, (1, 2): 0.024390243902439025}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 150.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=156.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9615384615384616, (2, 1): 0.02564102564102564, (2, 2): 0.01282051282051282}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9615384615384616, (2, 1): 0.02564102564102564, (2, 2): 0.01282051282051282}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 150.0 -> 150.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 163.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=168.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9702380952380952, (2, 1): 0.023809523809523808, (2, 2): 0.005952380952380952}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9702380952380952, (2, 1): 0.023809523809523808, (2, 2): 0.005952380952380952}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 163.0}
in get_filtered_urn(filter=0) --- total: total=165.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006060606060606061, (0, 1): 0.006060606060606061, (0, 2): 0.9878787878787879}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.006060606060606061, (0, 1): 0.006060606060606061, (0, 2): 0.9878787878787879}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 163.0 -> 164.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 163.0 -> 164.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 150.0}
in get_filtered_urn(filter=0) --- total: total=162.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012345679012345678, (0, 1): 0.06172839506172839, (0, 2): 0.9259259259259259}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.012345679012345678, (0, 1): 0.06172839506172839, (0, 2): 0.9259259259259259}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 150.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=156.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9615384615384616, (2, 1): 0.02564102564102564, (2, 2): 0.01282051282051282}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9615384615384616, (2, 1): 0.02564102564102564, (2, 2): 0.01282051282051282}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 150.0 -> 151.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 150.0 -> 151.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 203.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=205.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004878048780487805, (0, 1): 0.9902439024390244, (0, 2): 0.004878048780487805}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004878048780487805, (0, 1): 0.9902439024390244, (0, 2): 0.004878048780487805}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 203.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=208.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9759615384615384, (1, 1): 0.004807692307692308, (1, 2): 0.019230769230769232}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9759615384615384, (1, 1): 0.004807692307692308, (1, 2): 0.019230769230769232}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 203.0 -> 204.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 203.0 -> 204.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 158.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=164.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9634146341463414, (1, 1): 0.012195121951219513, (1, 2): 0.024390243902439025}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9634146341463414, (1, 1): 0.012195121951219513, (1, 2): 0.024390243902439025}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 158.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=169.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011834319526627219, (0, 1): 0.9349112426035503, (0, 2): 0.05325443786982249}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011834319526627219, (0, 1): 0.9349112426035503, (0, 2): 0.05325443786982249}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 158.0 -> 159.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 158.0 -> 159.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 164.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=169.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9704142011834319, (2, 1): 0.023668639053254437, (2, 2): 0.005917159763313609}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9704142011834319, (2, 1): 0.023668639053254437, (2, 2): 0.005917159763313609}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 164.0}
in get_filtered_urn(filter=0) --- total: total=166.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006024096385542169, (0, 1): 0.006024096385542169, (0, 2): 0.9879518072289156}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.006024096385542169, (0, 1): 0.006024096385542169, (0, 2): 0.9879518072289156}
in decode_message(signal=0) Receiver 2 got option: (0, 1) and decoded action: 1
Receiver 2 received signals: [0] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 0): 164.0 -> 164.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (0, 1): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 137.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=148.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.060810810810810814, (2, 1): 0.9256756756756757, (2, 2): 0.013513513513513514}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.060810810810810814, (2, 1): 0.9256756756756757, (2, 2): 0.013513513513513514}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 137.0}
in get_filtered_urn(filter=1) --- total: total=149.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06711409395973154, (1, 1): 0.013422818791946308, (1, 2): 0.9194630872483222}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06711409395973154, (1, 1): 0.013422818791946308, (1, 2): 0.9194630872483222}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 137.0 -> 138.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 137.0 -> 138.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 164.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=169.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9704142011834319, (2, 1): 0.023668639053254437, (2, 2): 0.005917159763313609}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9704142011834319, (2, 1): 0.023668639053254437, (2, 2): 0.005917159763313609}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 164.0}
in get_filtered_urn(filter=0) --- total: total=166.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.006024096385542169, (0, 1): 0.006024096385542169, (0, 2): 0.9879518072289156}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.006024096385542169, (0, 1): 0.006024096385542169, (0, 2): 0.9879518072289156}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 164.0 -> 165.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 164.0 -> 165.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 151.0}
in get_filtered_urn(filter=0) --- total: total=163.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012269938650306749, (0, 1): 0.06134969325153374, (0, 2): 0.9263803680981595}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.012269938650306749, (0, 1): 0.06134969325153374, (0, 2): 0.9263803680981595}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 138.0}
in get_filtered_urn(filter=1) --- total: total=150.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06666666666666667, (1, 1): 0.013333333333333334, (1, 2): 0.92}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06666666666666667, (1, 1): 0.013333333333333334, (1, 2): 0.92}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 138.0 -> 138.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 165.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=170.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9705882352941176, (2, 1): 0.023529411764705882, (2, 2): 0.0058823529411764705}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9705882352941176, (2, 1): 0.023529411764705882, (2, 2): 0.0058823529411764705}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 165.0}
in get_filtered_urn(filter=0) --- total: total=167.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005988023952095809, (0, 1): 0.005988023952095809, (0, 2): 0.9880239520958084}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005988023952095809, (0, 1): 0.005988023952095809, (0, 2): 0.9880239520958084}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 165.0 -> 166.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 165.0 -> 166.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 151.0}
in get_filtered_urn(filter=0) --- total: total=163.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012269938650306749, (0, 1): 0.06134969325153374, (0, 2): 0.9263803680981595}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.012269938650306749, (0, 1): 0.06134969325153374, (0, 2): 0.9263803680981595}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 151.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=157.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9617834394904459, (2, 1): 0.025477707006369428, (2, 2): 0.012738853503184714}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9617834394904459, (2, 1): 0.025477707006369428, (2, 2): 0.012738853503184714}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 151.0 -> 152.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 151.0 -> 152.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 166.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=171.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9707602339181286, (2, 1): 0.023391812865497075, (2, 2): 0.005847953216374269}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9707602339181286, (2, 1): 0.023391812865497075, (2, 2): 0.005847953216374269}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 166.0}
in get_filtered_urn(filter=0) --- total: total=168.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005952380952380952, (0, 1): 0.005952380952380952, (0, 2): 0.9880952380952381}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005952380952380952, (0, 1): 0.005952380952380952, (0, 2): 0.9880952380952381}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 166.0 -> 167.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 166.0 -> 167.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 138.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=149.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.06040268456375839, (2, 1): 0.9261744966442953, (2, 2): 0.013422818791946308}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.06040268456375839, (2, 1): 0.9261744966442953, (2, 2): 0.013422818791946308}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 138.0}
in get_filtered_urn(filter=1) --- total: total=150.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06666666666666667, (1, 1): 0.013333333333333334, (1, 2): 0.92}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06666666666666667, (1, 1): 0.013333333333333334, (1, 2): 0.92}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 138.0 -> 139.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 138.0 -> 139.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 167.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=172.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9709302325581395, (2, 1): 0.023255813953488372, (2, 2): 0.005813953488372093}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9709302325581395, (2, 1): 0.023255813953488372, (2, 2): 0.005813953488372093}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 167.0}
in get_filtered_urn(filter=0) --- total: total=169.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005917159763313609, (0, 1): 0.005917159763313609, (0, 2): 0.9881656804733728}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005917159763313609, (0, 1): 0.005917159763313609, (0, 2): 0.9881656804733728}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 167.0 -> 168.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 167.0 -> 168.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 139.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=150.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.06, (2, 1): 0.9266666666666666, (2, 2): 0.013333333333333334}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.06, (2, 1): 0.9266666666666666, (2, 2): 0.013333333333333334}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 139.0}
in get_filtered_urn(filter=1) --- total: total=151.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06622516556291391, (1, 1): 0.013245033112582781, (1, 2): 0.9205298013245033}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06622516556291391, (1, 1): 0.013245033112582781, (1, 2): 0.9205298013245033}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 139.0 -> 140.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 139.0 -> 140.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 204.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=206.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0048543689320388345, (0, 1): 0.9902912621359223, (0, 2): 0.0048543689320388345}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0048543689320388345, (0, 1): 0.9902912621359223, (0, 2): 0.0048543689320388345}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 204.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=209.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9760765550239234, (1, 1): 0.004784688995215311, (1, 2): 0.019138755980861243}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9760765550239234, (1, 1): 0.004784688995215311, (1, 2): 0.019138755980861243}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 204.0 -> 205.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 204.0 -> 205.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 140.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=151.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.059602649006622516, (2, 1): 0.9271523178807947, (2, 2): 0.013245033112582781}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.059602649006622516, (2, 1): 0.9271523178807947, (2, 2): 0.013245033112582781}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 140.0}
in get_filtered_urn(filter=1) --- total: total=152.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06578947368421052, (1, 1): 0.013157894736842105, (1, 2): 0.9210526315789473}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06578947368421052, (1, 1): 0.013157894736842105, (1, 2): 0.9210526315789473}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 140.0 -> 141.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 140.0 -> 141.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 168.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=173.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9710982658959537, (2, 1): 0.023121387283236993, (2, 2): 0.005780346820809248}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9710982658959537, (2, 1): 0.023121387283236993, (2, 2): 0.005780346820809248}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 168.0}
in get_filtered_urn(filter=0) --- total: total=170.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0058823529411764705, (0, 1): 0.0058823529411764705, (0, 2): 0.9882352941176471}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0058823529411764705, (0, 1): 0.0058823529411764705, (0, 2): 0.9882352941176471}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 168.0 -> 169.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 168.0 -> 169.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 152.0}
in get_filtered_urn(filter=0) --- total: total=164.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012195121951219513, (0, 1): 0.06097560975609756, (0, 2): 0.926829268292683}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.012195121951219513, (0, 1): 0.06097560975609756, (0, 2): 0.926829268292683}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 152.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=158.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9620253164556962, (2, 1): 0.02531645569620253, (2, 2): 0.012658227848101266}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9620253164556962, (2, 1): 0.02531645569620253, (2, 2): 0.012658227848101266}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 152.0 -> 153.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 152.0 -> 153.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 169.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=174.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9712643678160919, (2, 1): 0.022988505747126436, (2, 2): 0.005747126436781609}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9712643678160919, (2, 1): 0.022988505747126436, (2, 2): 0.005747126436781609}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 169.0}
in get_filtered_urn(filter=0) --- total: total=171.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005847953216374269, (0, 1): 0.005847953216374269, (0, 2): 0.9883040935672515}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005847953216374269, (0, 1): 0.005847953216374269, (0, 2): 0.9883040935672515}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 169.0 -> 170.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 169.0 -> 170.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 141.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=152.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05921052631578947, (2, 1): 0.9276315789473685, (2, 2): 0.013157894736842105}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05921052631578947, (2, 1): 0.9276315789473685, (2, 2): 0.013157894736842105}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 141.0}
in get_filtered_urn(filter=1) --- total: total=153.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06535947712418301, (1, 1): 0.013071895424836602, (1, 2): 0.9215686274509803}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06535947712418301, (1, 1): 0.013071895424836602, (1, 2): 0.9215686274509803}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 141.0 -> 142.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 141.0 -> 142.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 170.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=175.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9714285714285714, (2, 1): 0.022857142857142857, (2, 2): 0.005714285714285714}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9714285714285714, (2, 1): 0.022857142857142857, (2, 2): 0.005714285714285714}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 170.0}
in get_filtered_urn(filter=0) --- total: total=172.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005813953488372093, (0, 1): 0.005813953488372093, (0, 2): 0.9883720930232558}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005813953488372093, (0, 1): 0.005813953488372093, (0, 2): 0.9883720930232558}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 170.0 -> 171.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 170.0 -> 171.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 142.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=153.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.058823529411764705, (2, 1): 0.9281045751633987, (2, 2): 0.013071895424836602}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.058823529411764705, (2, 1): 0.9281045751633987, (2, 2): 0.013071895424836602}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 142.0}
in get_filtered_urn(filter=1) --- total: total=154.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06493506493506493, (1, 1): 0.012987012987012988, (1, 2): 0.922077922077922}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06493506493506493, (1, 1): 0.012987012987012988, (1, 2): 0.922077922077922}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 142.0 -> 143.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 142.0 -> 143.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 171.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=176.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9715909090909091, (2, 1): 0.022727272727272728, (2, 2): 0.005681818181818182}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9715909090909091, (2, 1): 0.022727272727272728, (2, 2): 0.005681818181818182}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 171.0}
in get_filtered_urn(filter=0) --- total: total=173.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005780346820809248, (0, 1): 0.005780346820809248, (0, 2): 0.9884393063583815}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005780346820809248, (0, 1): 0.005780346820809248, (0, 2): 0.9884393063583815}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 171.0 -> 172.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 171.0 -> 172.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 153.0}
in get_filtered_urn(filter=0) --- total: total=165.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012121212121212121, (0, 1): 0.06060606060606061, (0, 2): 0.9272727272727272}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.012121212121212121, (0, 1): 0.06060606060606061, (0, 2): 0.9272727272727272}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 153.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=159.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9622641509433962, (2, 1): 0.025157232704402517, (2, 2): 0.012578616352201259}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9622641509433962, (2, 1): 0.025157232704402517, (2, 2): 0.012578616352201259}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 153.0 -> 154.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 153.0 -> 154.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 172.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=177.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9717514124293786, (2, 1): 0.022598870056497175, (2, 2): 0.005649717514124294}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9717514124293786, (2, 1): 0.022598870056497175, (2, 2): 0.005649717514124294}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 172.0}
in get_filtered_urn(filter=0) --- total: total=174.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005747126436781609, (0, 1): 0.005747126436781609, (0, 2): 0.9885057471264368}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005747126436781609, (0, 1): 0.005747126436781609, (0, 2): 0.9885057471264368}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 172.0 -> 173.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 172.0 -> 173.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 154.0}
in get_filtered_urn(filter=0) --- total: total=166.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012048192771084338, (0, 1): 0.060240963855421686, (0, 2): 0.927710843373494}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.012048192771084338, (0, 1): 0.060240963855421686, (0, 2): 0.927710843373494}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 143.0}
in get_filtered_urn(filter=1) --- total: total=155.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06451612903225806, (1, 1): 0.012903225806451613, (1, 2): 0.9225806451612903}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06451612903225806, (1, 1): 0.012903225806451613, (1, 2): 0.9225806451612903}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 143.0 -> 143.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 205.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=207.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004830917874396135, (0, 1): 0.9903381642512077, (0, 2): 0.004830917874396135}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004830917874396135, (0, 1): 0.9903381642512077, (0, 2): 0.004830917874396135}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 205.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=210.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9761904761904762, (1, 1): 0.004761904761904762, (1, 2): 0.01904761904761905}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9761904761904762, (1, 1): 0.004761904761904762, (1, 2): 0.01904761904761905}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 205.0 -> 206.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 205.0 -> 206.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 159.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=165.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9636363636363636, (1, 1): 0.012121212121212121, (1, 2): 0.024242424242424242}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9636363636363636, (1, 1): 0.012121212121212121, (1, 2): 0.024242424242424242}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 159.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=170.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011764705882352941, (0, 1): 0.9352941176470588, (0, 2): 0.052941176470588235}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.011764705882352941, (0, 1): 0.9352941176470588, (0, 2): 0.052941176470588235}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 159.0 -> 159.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 9.0 -> 9.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 206.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=208.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004807692307692308, (0, 1): 0.9903846153846154, (0, 2): 0.004807692307692308}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004807692307692308, (0, 1): 0.9903846153846154, (0, 2): 0.004807692307692308}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 206.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=211.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.976303317535545, (1, 1): 0.004739336492890996, (1, 2): 0.018957345971563982}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.976303317535545, (1, 1): 0.004739336492890996, (1, 2): 0.018957345971563982}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 206.0 -> 207.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 206.0 -> 207.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 143.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=154.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05844155844155844, (2, 1): 0.9285714285714286, (2, 2): 0.012987012987012988}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05844155844155844, (2, 1): 0.9285714285714286, (2, 2): 0.012987012987012988}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 143.0}
in get_filtered_urn(filter=1) --- total: total=155.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06451612903225806, (1, 1): 0.012903225806451613, (1, 2): 0.9225806451612903}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06451612903225806, (1, 1): 0.012903225806451613, (1, 2): 0.9225806451612903}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 143.0 -> 144.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 143.0 -> 144.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 173.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=178.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9719101123595506, (2, 1): 0.02247191011235955, (2, 2): 0.0056179775280898875}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9719101123595506, (2, 1): 0.02247191011235955, (2, 2): 0.0056179775280898875}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 173.0}
in get_filtered_urn(filter=0) --- total: total=175.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005714285714285714, (0, 1): 0.005714285714285714, (0, 2): 0.9885714285714285}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005714285714285714, (0, 1): 0.005714285714285714, (0, 2): 0.9885714285714285}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 173.0 -> 174.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 173.0 -> 174.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 144.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=155.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05806451612903226, (2, 1): 0.9290322580645162, (2, 2): 0.012903225806451613}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05806451612903226, (2, 1): 0.9290322580645162, (2, 2): 0.012903225806451613}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 144.0}
in get_filtered_urn(filter=1) --- total: total=156.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0641025641025641, (1, 1): 0.01282051282051282, (1, 2): 0.9230769230769231}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0641025641025641, (1, 1): 0.01282051282051282, (1, 2): 0.9230769230769231}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 144.0 -> 145.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 144.0 -> 145.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 207.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=209.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004784688995215311, (0, 1): 0.9904306220095693, (0, 2): 0.004784688995215311}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004784688995215311, (0, 1): 0.9904306220095693, (0, 2): 0.004784688995215311}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 207.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=212.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9764150943396226, (1, 1): 0.0047169811320754715, (1, 2): 0.018867924528301886}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9764150943396226, (1, 1): 0.0047169811320754715, (1, 2): 0.018867924528301886}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 207.0 -> 208.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 207.0 -> 208.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 159.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=165.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9636363636363636, (1, 1): 0.012121212121212121, (1, 2): 0.024242424242424242}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.9636363636363636, (1, 1): 0.012121212121212121, (1, 2): 0.024242424242424242}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 154.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=160.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9625, (2, 1): 0.025, (2, 2): 0.0125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9625, (2, 1): 0.025, (2, 2): 0.0125}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 154.0 -> 154.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 208.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=210.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004761904761904762, (0, 1): 0.9904761904761905, (0, 2): 0.004761904761904762}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004761904761904762, (0, 1): 0.9904761904761905, (0, 2): 0.004761904761904762}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 208.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=213.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9765258215962441, (1, 1): 0.004694835680751174, (1, 2): 0.018779342723004695}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9765258215962441, (1, 1): 0.004694835680751174, (1, 2): 0.018779342723004695}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 208.0 -> 209.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 208.0 -> 209.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 154.0}
in get_filtered_urn(filter=0) --- total: total=166.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.012048192771084338, (0, 1): 0.060240963855421686, (0, 2): 0.927710843373494}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.012048192771084338, (0, 1): 0.060240963855421686, (0, 2): 0.927710843373494}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 154.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=160.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9625, (2, 1): 0.025, (2, 2): 0.0125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9625, (2, 1): 0.025, (2, 2): 0.0125}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 154.0 -> 155.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 154.0 -> 155.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 174.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=179.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9720670391061452, (2, 1): 0.0223463687150838, (2, 2): 0.00558659217877095}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9720670391061452, (2, 1): 0.0223463687150838, (2, 2): 0.00558659217877095}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 174.0}
in get_filtered_urn(filter=0) --- total: total=176.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005681818181818182, (0, 1): 0.005681818181818182, (0, 2): 0.9886363636363636}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005681818181818182, (0, 1): 0.005681818181818182, (0, 2): 0.9886363636363636}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 174.0 -> 175.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 174.0 -> 175.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 155.0}
in get_filtered_urn(filter=0) --- total: total=167.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011976047904191617, (0, 1): 0.059880239520958084, (0, 2): 0.9281437125748503}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011976047904191617, (0, 1): 0.059880239520958084, (0, 2): 0.9281437125748503}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 145.0}
in get_filtered_urn(filter=1) --- total: total=157.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06369426751592357, (1, 1): 0.012738853503184714, (1, 2): 0.9235668789808917}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06369426751592357, (1, 1): 0.012738853503184714, (1, 2): 0.9235668789808917}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 145.0 -> 145.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 209.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=211.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004739336492890996, (0, 1): 0.990521327014218, (0, 2): 0.004739336492890996}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004739336492890996, (0, 1): 0.990521327014218, (0, 2): 0.004739336492890996}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 209.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=214.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9766355140186916, (1, 1): 0.004672897196261682, (1, 2): 0.018691588785046728}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9766355140186916, (1, 1): 0.004672897196261682, (1, 2): 0.018691588785046728}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 209.0 -> 210.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 209.0 -> 210.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 159.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=165.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9636363636363636, (1, 1): 0.012121212121212121, (1, 2): 0.024242424242424242}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9636363636363636, (1, 1): 0.012121212121212121, (1, 2): 0.024242424242424242}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 159.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=170.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011764705882352941, (0, 1): 0.9352941176470588, (0, 2): 0.052941176470588235}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011764705882352941, (0, 1): 0.9352941176470588, (0, 2): 0.052941176470588235}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 159.0 -> 160.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 159.0 -> 160.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 210.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=212.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0047169811320754715, (0, 1): 0.9905660377358491, (0, 2): 0.0047169811320754715}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0047169811320754715, (0, 1): 0.9905660377358491, (0, 2): 0.0047169811320754715}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 210.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=215.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9767441860465116, (1, 1): 0.004651162790697674, (1, 2): 0.018604651162790697}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9767441860465116, (1, 1): 0.004651162790697674, (1, 2): 0.018604651162790697}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 210.0 -> 211.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 210.0 -> 211.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 145.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=156.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.057692307692307696, (2, 1): 0.9294871794871795, (2, 2): 0.01282051282051282}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.057692307692307696, (2, 1): 0.9294871794871795, (2, 2): 0.01282051282051282}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 145.0}
in get_filtered_urn(filter=1) --- total: total=157.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06369426751592357, (1, 1): 0.012738853503184714, (1, 2): 0.9235668789808917}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06369426751592357, (1, 1): 0.012738853503184714, (1, 2): 0.9235668789808917}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 145.0 -> 146.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 145.0 -> 146.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 211.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=213.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004694835680751174, (0, 1): 0.9906103286384976, (0, 2): 0.004694835680751174}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004694835680751174, (0, 1): 0.9906103286384976, (0, 2): 0.004694835680751174}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 211.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=216.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9768518518518519, (1, 1): 0.004629629629629629, (1, 2): 0.018518518518518517}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9768518518518519, (1, 1): 0.004629629629629629, (1, 2): 0.018518518518518517}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 211.0 -> 212.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 211.0 -> 212.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 146.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=157.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05732484076433121, (2, 1): 0.9299363057324841, (2, 2): 0.012738853503184714}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05732484076433121, (2, 1): 0.9299363057324841, (2, 2): 0.012738853503184714}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 146.0}
in get_filtered_urn(filter=1) --- total: total=158.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06329113924050633, (1, 1): 0.012658227848101266, (1, 2): 0.9240506329113924}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06329113924050633, (1, 1): 0.012658227848101266, (1, 2): 0.9240506329113924}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 146.0 -> 147.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 146.0 -> 147.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 232.0}
in get_filtered_urn(filter=1) --- total: total=234.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004273504273504274, (1, 1): 0.004273504273504274, (1, 2): 0.9914529914529915}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004273504273504274, (1, 1): 0.004273504273504274, (1, 2): 0.9914529914529915}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 232.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=234.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004273504273504274, (2, 1): 0.9914529914529915, (2, 2): 0.004273504273504274}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004273504273504274, (2, 1): 0.9914529914529915, (2, 2): 0.004273504273504274}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 232.0 -> 233.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 232.0 -> 233.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 155.0}
in get_filtered_urn(filter=0) --- total: total=167.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011976047904191617, (0, 1): 0.059880239520958084, (0, 2): 0.9281437125748503}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.011976047904191617, (0, 1): 0.059880239520958084, (0, 2): 0.9281437125748503}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 155.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=161.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9627329192546584, (2, 1): 0.024844720496894408, (2, 2): 0.012422360248447204}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9627329192546584, (2, 1): 0.024844720496894408, (2, 2): 0.012422360248447204}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 155.0 -> 156.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 155.0 -> 156.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 175.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=180.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9722222222222222, (2, 1): 0.022222222222222223, (2, 2): 0.005555555555555556}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9722222222222222, (2, 1): 0.022222222222222223, (2, 2): 0.005555555555555556}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 175.0}
in get_filtered_urn(filter=0) --- total: total=177.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005649717514124294, (0, 1): 0.005649717514124294, (0, 2): 0.9887005649717514}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005649717514124294, (0, 1): 0.005649717514124294, (0, 2): 0.9887005649717514}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 175.0 -> 176.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 175.0 -> 176.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 147.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=158.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.056962025316455694, (2, 1): 0.930379746835443, (2, 2): 0.012658227848101266}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.056962025316455694, (2, 1): 0.930379746835443, (2, 2): 0.012658227848101266}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 147.0}
in get_filtered_urn(filter=1) --- total: total=159.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06289308176100629, (1, 1): 0.012578616352201259, (1, 2): 0.9245283018867925}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06289308176100629, (1, 1): 0.012578616352201259, (1, 2): 0.9245283018867925}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 147.0 -> 148.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 147.0 -> 148.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 233.0}
in get_filtered_urn(filter=1) --- total: total=235.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.00425531914893617, (1, 1): 0.00425531914893617, (1, 2): 0.9914893617021276}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.00425531914893617, (1, 1): 0.00425531914893617, (1, 2): 0.9914893617021276}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 233.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=235.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.00425531914893617, (2, 1): 0.9914893617021276, (2, 2): 0.00425531914893617}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.00425531914893617, (2, 1): 0.9914893617021276, (2, 2): 0.00425531914893617}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 233.0 -> 234.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 233.0 -> 234.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 156.0}
in get_filtered_urn(filter=0) --- total: total=168.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011904761904761904, (0, 1): 0.05952380952380952, (0, 2): 0.9285714285714286}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.011904761904761904, (0, 1): 0.05952380952380952, (0, 2): 0.9285714285714286}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 156.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=162.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9629629629629629, (2, 1): 0.024691358024691357, (2, 2): 0.012345679012345678}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9629629629629629, (2, 1): 0.024691358024691357, (2, 2): 0.012345679012345678}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 156.0 -> 157.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 156.0 -> 157.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 234.0}
in get_filtered_urn(filter=1) --- total: total=236.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.00423728813559322, (1, 1): 0.00423728813559322, (1, 2): 0.9915254237288136}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.00423728813559322, (1, 1): 0.00423728813559322, (1, 2): 0.9915254237288136}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 234.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=236.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.00423728813559322, (2, 1): 0.9915254237288136, (2, 2): 0.00423728813559322}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.00423728813559322, (2, 1): 0.9915254237288136, (2, 2): 0.00423728813559322}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 234.0 -> 235.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 234.0 -> 235.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 157.0}
in get_filtered_urn(filter=0) --- total: total=169.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011834319526627219, (0, 1): 0.05917159763313609, (0, 2): 0.9289940828402367}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.011834319526627219, (0, 1): 0.05917159763313609, (0, 2): 0.9289940828402367}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 157.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=163.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9631901840490797, (2, 1): 0.024539877300613498, (2, 2): 0.012269938650306749}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9631901840490797, (2, 1): 0.024539877300613498, (2, 2): 0.012269938650306749}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 157.0 -> 158.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 157.0 -> 158.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 176.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=181.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9723756906077348, (2, 1): 0.022099447513812154, (2, 2): 0.0055248618784530384}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9723756906077348, (2, 1): 0.022099447513812154, (2, 2): 0.0055248618784530384}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 176.0}
in get_filtered_urn(filter=0) --- total: total=178.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0056179775280898875, (0, 1): 0.0056179775280898875, (0, 2): 0.9887640449438202}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0056179775280898875, (0, 1): 0.0056179775280898875, (0, 2): 0.9887640449438202}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 176.0 -> 177.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 176.0 -> 177.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 148.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=159.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05660377358490566, (2, 1): 0.9308176100628931, (2, 2): 0.012578616352201259}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05660377358490566, (2, 1): 0.9308176100628931, (2, 2): 0.012578616352201259}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 148.0}
in get_filtered_urn(filter=1) --- total: total=160.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0625, (1, 1): 0.0125, (1, 2): 0.925}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0625, (1, 1): 0.0125, (1, 2): 0.925}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 148.0 -> 149.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 148.0 -> 149.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 212.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=214.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004672897196261682, (0, 1): 0.9906542056074766, (0, 2): 0.004672897196261682}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004672897196261682, (0, 1): 0.9906542056074766, (0, 2): 0.004672897196261682}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 212.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=217.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9769585253456221, (1, 1): 0.004608294930875576, (1, 2): 0.018433179723502304}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9769585253456221, (1, 1): 0.004608294930875576, (1, 2): 0.018433179723502304}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 212.0 -> 213.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 212.0 -> 213.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 149.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=160.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05625, (2, 1): 0.93125, (2, 2): 0.0125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05625, (2, 1): 0.93125, (2, 2): 0.0125}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 149.0}
in get_filtered_urn(filter=1) --- total: total=161.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.062111801242236024, (1, 1): 0.012422360248447204, (1, 2): 0.9254658385093167}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.062111801242236024, (1, 1): 0.012422360248447204, (1, 2): 0.9254658385093167}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 149.0 -> 150.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 149.0 -> 150.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 177.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=182.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9725274725274725, (2, 1): 0.02197802197802198, (2, 2): 0.005494505494505495}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9725274725274725, (2, 1): 0.02197802197802198, (2, 2): 0.005494505494505495}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 177.0}
in get_filtered_urn(filter=0) --- total: total=179.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00558659217877095, (0, 1): 0.00558659217877095, (0, 2): 0.9888268156424581}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00558659217877095, (0, 1): 0.00558659217877095, (0, 2): 0.9888268156424581}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 177.0 -> 178.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 177.0 -> 178.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 160.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=166.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.963855421686747, (1, 1): 0.012048192771084338, (1, 2): 0.024096385542168676}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.963855421686747, (1, 1): 0.012048192771084338, (1, 2): 0.024096385542168676}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 160.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=171.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011695906432748537, (0, 1): 0.935672514619883, (0, 2): 0.05263157894736842}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011695906432748537, (0, 1): 0.935672514619883, (0, 2): 0.05263157894736842}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 160.0 -> 161.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 160.0 -> 161.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 178.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=183.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9726775956284153, (2, 1): 0.02185792349726776, (2, 2): 0.00546448087431694}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9726775956284153, (2, 1): 0.02185792349726776, (2, 2): 0.00546448087431694}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 178.0}
in get_filtered_urn(filter=0) --- total: total=180.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005555555555555556, (0, 1): 0.005555555555555556, (0, 2): 0.9888888888888889}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005555555555555556, (0, 1): 0.005555555555555556, (0, 2): 0.9888888888888889}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 178.0 -> 179.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 178.0 -> 179.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 150.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=161.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.055900621118012424, (2, 1): 0.9316770186335404, (2, 2): 0.012422360248447204}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.055900621118012424, (2, 1): 0.9316770186335404, (2, 2): 0.012422360248447204}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 150.0}
in get_filtered_urn(filter=1) --- total: total=162.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06172839506172839, (1, 1): 0.012345679012345678, (1, 2): 0.9259259259259259}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06172839506172839, (1, 1): 0.012345679012345678, (1, 2): 0.9259259259259259}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 150.0 -> 151.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 150.0 -> 151.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 235.0}
in get_filtered_urn(filter=1) --- total: total=237.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004219409282700422, (1, 1): 0.004219409282700422, (1, 2): 0.9915611814345991}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004219409282700422, (1, 1): 0.004219409282700422, (1, 2): 0.9915611814345991}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 235.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=237.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004219409282700422, (2, 1): 0.9915611814345991, (2, 2): 0.004219409282700422}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004219409282700422, (2, 1): 0.9915611814345991, (2, 2): 0.004219409282700422}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 235.0 -> 236.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 235.0 -> 236.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 151.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=162.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05555555555555555, (2, 1): 0.9320987654320988, (2, 2): 0.012345679012345678}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.05555555555555555, (2, 1): 0.9320987654320988, (2, 2): 0.012345679012345678}
Sender 4 got filter 2 choose option: (2, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 158.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=164.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9634146341463414, (2, 1): 0.024390243902439025, (2, 2): 0.012195121951219513}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9634146341463414, (2, 1): 0.024390243902439025, (2, 2): 0.012195121951219513}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 158.0 -> 158.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 236.0}
in get_filtered_urn(filter=1) --- total: total=238.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004201680672268907, (1, 1): 0.004201680672268907, (1, 2): 0.9915966386554622}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004201680672268907, (1, 1): 0.004201680672268907, (1, 2): 0.9915966386554622}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 236.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=238.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004201680672268907, (2, 1): 0.9915966386554622, (2, 2): 0.004201680672268907}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004201680672268907, (2, 1): 0.9915966386554622, (2, 2): 0.004201680672268907}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 236.0 -> 237.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 236.0 -> 237.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 161.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=167.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9640718562874252, (1, 1): 0.011976047904191617, (1, 2): 0.023952095808383235}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9640718562874252, (1, 1): 0.011976047904191617, (1, 2): 0.023952095808383235}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 161.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=172.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011627906976744186, (0, 1): 0.936046511627907, (0, 2): 0.05232558139534884}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011627906976744186, (0, 1): 0.936046511627907, (0, 2): 0.05232558139534884}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 161.0 -> 162.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 161.0 -> 162.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 213.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=215.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004651162790697674, (0, 1): 0.9906976744186047, (0, 2): 0.004651162790697674}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004651162790697674, (0, 1): 0.9906976744186047, (0, 2): 0.004651162790697674}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 213.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=218.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9770642201834863, (1, 1): 0.0045871559633027525, (1, 2): 0.01834862385321101}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9770642201834863, (1, 1): 0.0045871559633027525, (1, 2): 0.01834862385321101}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 213.0 -> 214.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 213.0 -> 214.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 162.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=168.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9642857142857143, (1, 1): 0.011904761904761904, (1, 2): 0.023809523809523808}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9642857142857143, (1, 1): 0.011904761904761904, (1, 2): 0.023809523809523808}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 162.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=173.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011560693641618497, (0, 1): 0.9364161849710982, (0, 2): 0.05202312138728324}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011560693641618497, (0, 1): 0.9364161849710982, (0, 2): 0.05202312138728324}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 162.0 -> 163.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 162.0 -> 163.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 237.0}
in get_filtered_urn(filter=1) --- total: total=239.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0041841004184100415, (1, 1): 0.0041841004184100415, (1, 2): 0.9916317991631799}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0041841004184100415, (1, 1): 0.0041841004184100415, (1, 2): 0.9916317991631799}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 237.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=239.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0041841004184100415, (2, 1): 0.9916317991631799, (2, 2): 0.0041841004184100415}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0041841004184100415, (2, 1): 0.9916317991631799, (2, 2): 0.0041841004184100415}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 237.0 -> 238.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 237.0 -> 238.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 158.0}
in get_filtered_urn(filter=0) --- total: total=170.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011764705882352941, (0, 1): 0.058823529411764705, (0, 2): 0.9294117647058824}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.011764705882352941, (0, 1): 0.058823529411764705, (0, 2): 0.9294117647058824}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 158.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=164.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9634146341463414, (2, 1): 0.024390243902439025, (2, 2): 0.012195121951219513}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9634146341463414, (2, 1): 0.024390243902439025, (2, 2): 0.012195121951219513}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 158.0 -> 159.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 158.0 -> 159.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 238.0}
in get_filtered_urn(filter=1) --- total: total=240.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004166666666666667, (1, 1): 0.004166666666666667, (1, 2): 0.9916666666666667}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004166666666666667, (1, 1): 0.004166666666666667, (1, 2): 0.9916666666666667}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 238.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=240.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004166666666666667, (2, 1): 0.9916666666666667, (2, 2): 0.004166666666666667}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004166666666666667, (2, 1): 0.9916666666666667, (2, 2): 0.004166666666666667}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 238.0 -> 239.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 238.0 -> 239.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 163.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=169.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9644970414201184, (1, 1): 0.011834319526627219, (1, 2): 0.023668639053254437}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9644970414201184, (1, 1): 0.011834319526627219, (1, 2): 0.023668639053254437}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 163.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=174.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011494252873563218, (0, 1): 0.9367816091954023, (0, 2): 0.05172413793103448}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011494252873563218, (0, 1): 0.9367816091954023, (0, 2): 0.05172413793103448}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 163.0 -> 164.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 163.0 -> 164.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 179.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=184.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9728260869565217, (2, 1): 0.021739130434782608, (2, 2): 0.005434782608695652}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9728260869565217, (2, 1): 0.021739130434782608, (2, 2): 0.005434782608695652}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 179.0}
in get_filtered_urn(filter=0) --- total: total=181.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0055248618784530384, (0, 1): 0.0055248618784530384, (0, 2): 0.988950276243094}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0055248618784530384, (0, 1): 0.0055248618784530384, (0, 2): 0.988950276243094}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 179.0 -> 180.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 179.0 -> 180.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 164.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=170.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9647058823529412, (1, 1): 0.011764705882352941, (1, 2): 0.023529411764705882}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.9647058823529412, (1, 1): 0.011764705882352941, (1, 2): 0.023529411764705882}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 159.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=165.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9636363636363636, (2, 1): 0.024242424242424242, (2, 2): 0.012121212121212121}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9636363636363636, (2, 1): 0.024242424242424242, (2, 2): 0.012121212121212121}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 159.0 -> 159.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 214.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=216.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004629629629629629, (0, 1): 0.9907407407407407, (0, 2): 0.004629629629629629}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004629629629629629, (0, 1): 0.9907407407407407, (0, 2): 0.004629629629629629}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 214.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=219.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9771689497716894, (1, 1): 0.0045662100456621, (1, 2): 0.0182648401826484}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9771689497716894, (1, 1): 0.0045662100456621, (1, 2): 0.0182648401826484}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 214.0 -> 215.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 214.0 -> 215.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 159.0}
in get_filtered_urn(filter=0) --- total: total=171.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011695906432748537, (0, 1): 0.05847953216374269, (0, 2): 0.9298245614035088}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.011695906432748537, (0, 1): 0.05847953216374269, (0, 2): 0.9298245614035088}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 159.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=165.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9636363636363636, (2, 1): 0.024242424242424242, (2, 2): 0.012121212121212121}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9636363636363636, (2, 1): 0.024242424242424242, (2, 2): 0.012121212121212121}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 159.0 -> 160.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 159.0 -> 160.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 180.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=185.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.972972972972973, (2, 1): 0.021621621621621623, (2, 2): 0.005405405405405406}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.972972972972973, (2, 1): 0.021621621621621623, (2, 2): 0.005405405405405406}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 180.0}
in get_filtered_urn(filter=0) --- total: total=182.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005494505494505495, (0, 1): 0.005494505494505495, (0, 2): 0.989010989010989}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005494505494505495, (0, 1): 0.005494505494505495, (0, 2): 0.989010989010989}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 180.0 -> 181.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 180.0 -> 181.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 164.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=170.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9647058823529412, (1, 1): 0.011764705882352941, (1, 2): 0.023529411764705882}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9647058823529412, (1, 1): 0.011764705882352941, (1, 2): 0.023529411764705882}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 164.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=175.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011428571428571429, (0, 1): 0.9371428571428572, (0, 2): 0.05142857142857143}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011428571428571429, (0, 1): 0.9371428571428572, (0, 2): 0.05142857142857143}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 164.0 -> 165.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 164.0 -> 165.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 181.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=186.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9731182795698925, (2, 1): 0.021505376344086023, (2, 2): 0.005376344086021506}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9731182795698925, (2, 1): 0.021505376344086023, (2, 2): 0.005376344086021506}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 181.0}
in get_filtered_urn(filter=0) --- total: total=183.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00546448087431694, (0, 1): 0.00546448087431694, (0, 2): 0.9890710382513661}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00546448087431694, (0, 1): 0.00546448087431694, (0, 2): 0.9890710382513661}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 181.0 -> 182.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 181.0 -> 182.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 160.0}
in get_filtered_urn(filter=0) --- total: total=172.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011627906976744186, (0, 1): 0.05813953488372093, (0, 2): 0.9302325581395349}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.011627906976744186, (0, 1): 0.05813953488372093, (0, 2): 0.9302325581395349}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 160.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=166.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.963855421686747, (2, 1): 0.024096385542168676, (2, 2): 0.012048192771084338}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.963855421686747, (2, 1): 0.024096385542168676, (2, 2): 0.012048192771084338}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 160.0 -> 161.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 160.0 -> 161.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 182.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=187.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9732620320855615, (2, 1): 0.0213903743315508, (2, 2): 0.0053475935828877}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9732620320855615, (2, 1): 0.0213903743315508, (2, 2): 0.0053475935828877}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 182.0}
in get_filtered_urn(filter=0) --- total: total=184.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005434782608695652, (0, 1): 0.005434782608695652, (0, 2): 0.9891304347826086}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005434782608695652, (0, 1): 0.005434782608695652, (0, 2): 0.9891304347826086}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 182.0 -> 183.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 182.0 -> 183.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 151.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=162.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05555555555555555, (2, 1): 0.9320987654320988, (2, 2): 0.012345679012345678}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05555555555555555, (2, 1): 0.9320987654320988, (2, 2): 0.012345679012345678}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 151.0}
in get_filtered_urn(filter=1) --- total: total=163.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06134969325153374, (1, 1): 0.012269938650306749, (1, 2): 0.9263803680981595}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06134969325153374, (1, 1): 0.012269938650306749, (1, 2): 0.9263803680981595}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 151.0 -> 152.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 151.0 -> 152.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 183.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=188.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.973404255319149, (2, 1): 0.02127659574468085, (2, 2): 0.005319148936170213}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.973404255319149, (2, 1): 0.02127659574468085, (2, 2): 0.005319148936170213}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 183.0}
in get_filtered_urn(filter=0) --- total: total=185.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005405405405405406, (0, 1): 0.005405405405405406, (0, 2): 0.9891891891891892}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005405405405405406, (0, 1): 0.005405405405405406, (0, 2): 0.9891891891891892}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 183.0 -> 184.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 183.0 -> 184.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 161.0}
in get_filtered_urn(filter=0) --- total: total=173.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011560693641618497, (0, 1): 0.057803468208092484, (0, 2): 0.930635838150289}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.011560693641618497, (0, 1): 0.057803468208092484, (0, 2): 0.930635838150289}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 161.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=167.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9640718562874252, (2, 1): 0.023952095808383235, (2, 2): 0.011976047904191617}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9640718562874252, (2, 1): 0.023952095808383235, (2, 2): 0.011976047904191617}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 161.0 -> 162.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 161.0 -> 162.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 239.0}
in get_filtered_urn(filter=1) --- total: total=241.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004149377593360996, (1, 1): 0.004149377593360996, (1, 2): 0.991701244813278}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004149377593360996, (1, 1): 0.004149377593360996, (1, 2): 0.991701244813278}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 239.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=241.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004149377593360996, (2, 1): 0.991701244813278, (2, 2): 0.004149377593360996}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004149377593360996, (2, 1): 0.991701244813278, (2, 2): 0.004149377593360996}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 239.0 -> 240.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 239.0 -> 240.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 152.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=163.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05521472392638037, (2, 1): 0.9325153374233128, (2, 2): 0.012269938650306749}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05521472392638037, (2, 1): 0.9325153374233128, (2, 2): 0.012269938650306749}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 152.0}
in get_filtered_urn(filter=1) --- total: total=164.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06097560975609756, (1, 1): 0.012195121951219513, (1, 2): 0.926829268292683}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06097560975609756, (1, 1): 0.012195121951219513, (1, 2): 0.926829268292683}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 152.0 -> 153.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 152.0 -> 153.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 184.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=189.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9735449735449735, (2, 1): 0.021164021164021163, (2, 2): 0.005291005291005291}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9735449735449735, (2, 1): 0.021164021164021163, (2, 2): 0.005291005291005291}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 184.0}
in get_filtered_urn(filter=0) --- total: total=186.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005376344086021506, (0, 1): 0.005376344086021506, (0, 2): 0.989247311827957}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005376344086021506, (0, 1): 0.005376344086021506, (0, 2): 0.989247311827957}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 184.0 -> 185.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 184.0 -> 185.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 162.0}
in get_filtered_urn(filter=0) --- total: total=174.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011494252873563218, (0, 1): 0.05747126436781609, (0, 2): 0.9310344827586207}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.011494252873563218, (0, 1): 0.05747126436781609, (0, 2): 0.9310344827586207}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 162.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=168.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9642857142857143, (2, 1): 0.023809523809523808, (2, 2): 0.011904761904761904}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9642857142857143, (2, 1): 0.023809523809523808, (2, 2): 0.011904761904761904}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 162.0 -> 163.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 162.0 -> 163.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 240.0}
in get_filtered_urn(filter=1) --- total: total=242.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004132231404958678, (1, 1): 0.004132231404958678, (1, 2): 0.9917355371900827}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004132231404958678, (1, 1): 0.004132231404958678, (1, 2): 0.9917355371900827}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 240.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=242.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004132231404958678, (2, 1): 0.9917355371900827, (2, 2): 0.004132231404958678}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004132231404958678, (2, 1): 0.9917355371900827, (2, 2): 0.004132231404958678}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 240.0 -> 241.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 240.0 -> 241.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 163.0}
in get_filtered_urn(filter=0) --- total: total=175.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011428571428571429, (0, 1): 0.05714285714285714, (0, 2): 0.9314285714285714}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.011428571428571429, (0, 1): 0.05714285714285714, (0, 2): 0.9314285714285714}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 163.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=169.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9644970414201184, (2, 1): 0.023668639053254437, (2, 2): 0.011834319526627219}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9644970414201184, (2, 1): 0.023668639053254437, (2, 2): 0.011834319526627219}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 163.0 -> 164.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 163.0 -> 164.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 185.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=190.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9736842105263158, (2, 1): 0.021052631578947368, (2, 2): 0.005263157894736842}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9736842105263158, (2, 1): 0.021052631578947368, (2, 2): 0.005263157894736842}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 185.0}
in get_filtered_urn(filter=0) --- total: total=187.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0053475935828877, (0, 1): 0.0053475935828877, (0, 2): 0.9893048128342246}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0053475935828877, (0, 1): 0.0053475935828877, (0, 2): 0.9893048128342246}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 185.0 -> 186.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 185.0 -> 186.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 164.0}
in get_filtered_urn(filter=0) --- total: total=176.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011363636363636364, (0, 1): 0.056818181818181816, (0, 2): 0.9318181818181818}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.011363636363636364, (0, 1): 0.056818181818181816, (0, 2): 0.9318181818181818}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 164.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=170.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9647058823529412, (2, 1): 0.023529411764705882, (2, 2): 0.011764705882352941}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9647058823529412, (2, 1): 0.023529411764705882, (2, 2): 0.011764705882352941}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 164.0 -> 165.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 164.0 -> 165.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 186.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=191.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9738219895287958, (2, 1): 0.020942408376963352, (2, 2): 0.005235602094240838}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9738219895287958, (2, 1): 0.020942408376963352, (2, 2): 0.005235602094240838}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 186.0}
in get_filtered_urn(filter=0) --- total: total=188.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005319148936170213, (0, 1): 0.005319148936170213, (0, 2): 0.9893617021276596}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005319148936170213, (0, 1): 0.005319148936170213, (0, 2): 0.9893617021276596}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 186.0 -> 187.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 186.0 -> 187.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 153.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=164.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.054878048780487805, (2, 1): 0.9329268292682927, (2, 2): 0.012195121951219513}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.054878048780487805, (2, 1): 0.9329268292682927, (2, 2): 0.012195121951219513}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 153.0}
in get_filtered_urn(filter=1) --- total: total=165.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.06060606060606061, (1, 1): 0.012121212121212121, (1, 2): 0.9272727272727272}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.06060606060606061, (1, 1): 0.012121212121212121, (1, 2): 0.9272727272727272}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 153.0 -> 154.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 153.0 -> 154.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 241.0}
in get_filtered_urn(filter=1) --- total: total=243.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.00411522633744856, (1, 1): 0.00411522633744856, (1, 2): 0.9917695473251029}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.00411522633744856, (1, 1): 0.00411522633744856, (1, 2): 0.9917695473251029}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 241.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=243.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.00411522633744856, (2, 1): 0.9917695473251029, (2, 2): 0.00411522633744856}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.00411522633744856, (2, 1): 0.9917695473251029, (2, 2): 0.00411522633744856}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 241.0 -> 242.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 241.0 -> 242.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 165.0}
in get_filtered_urn(filter=0) --- total: total=177.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011299435028248588, (0, 1): 0.05649717514124294, (0, 2): 0.9322033898305084}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.011299435028248588, (0, 1): 0.05649717514124294, (0, 2): 0.9322033898305084}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 165.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=171.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9649122807017544, (2, 1): 0.023391812865497075, (2, 2): 0.011695906432748537}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9649122807017544, (2, 1): 0.023391812865497075, (2, 2): 0.011695906432748537}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 165.0 -> 166.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 165.0 -> 166.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 215.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=217.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004608294930875576, (0, 1): 0.9907834101382489, (0, 2): 0.004608294930875576}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004608294930875576, (0, 1): 0.9907834101382489, (0, 2): 0.004608294930875576}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 215.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=220.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9772727272727273, (1, 1): 0.004545454545454545, (1, 2): 0.01818181818181818}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9772727272727273, (1, 1): 0.004545454545454545, (1, 2): 0.01818181818181818}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 215.0 -> 216.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 215.0 -> 216.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 166.0}
in get_filtered_urn(filter=0) --- total: total=178.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011235955056179775, (0, 1): 0.056179775280898875, (0, 2): 0.9325842696629213}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011235955056179775, (0, 1): 0.056179775280898875, (0, 2): 0.9325842696629213}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 154.0}
in get_filtered_urn(filter=1) --- total: total=166.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.060240963855421686, (1, 1): 0.012048192771084338, (1, 2): 0.927710843373494}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.060240963855421686, (1, 1): 0.012048192771084338, (1, 2): 0.927710843373494}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 154.0 -> 154.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 187.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=192.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9739583333333334, (2, 1): 0.020833333333333332, (2, 2): 0.005208333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9739583333333334, (2, 1): 0.020833333333333332, (2, 2): 0.005208333333333333}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 187.0}
in get_filtered_urn(filter=0) --- total: total=189.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005291005291005291, (0, 1): 0.005291005291005291, (0, 2): 0.9894179894179894}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005291005291005291, (0, 1): 0.005291005291005291, (0, 2): 0.9894179894179894}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 187.0 -> 188.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 187.0 -> 188.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 165.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=171.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9649122807017544, (1, 1): 0.011695906432748537, (1, 2): 0.023391812865497075}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9649122807017544, (1, 1): 0.011695906432748537, (1, 2): 0.023391812865497075}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 165.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=176.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011363636363636364, (0, 1): 0.9375, (0, 2): 0.05113636363636364}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011363636363636364, (0, 1): 0.9375, (0, 2): 0.05113636363636364}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 165.0 -> 166.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 165.0 -> 166.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 242.0}
in get_filtered_urn(filter=1) --- total: total=244.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004098360655737705, (1, 1): 0.004098360655737705, (1, 2): 0.9918032786885246}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004098360655737705, (1, 1): 0.004098360655737705, (1, 2): 0.9918032786885246}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 242.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=244.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004098360655737705, (2, 1): 0.9918032786885246, (2, 2): 0.004098360655737705}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004098360655737705, (2, 1): 0.9918032786885246, (2, 2): 0.004098360655737705}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 242.0 -> 243.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 242.0 -> 243.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 166.0}
in get_filtered_urn(filter=0) --- total: total=178.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011235955056179775, (0, 1): 0.056179775280898875, (0, 2): 0.9325842696629213}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.011235955056179775, (0, 1): 0.056179775280898875, (0, 2): 0.9325842696629213}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 166.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=172.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9651162790697675, (2, 1): 0.023255813953488372, (2, 2): 0.011627906976744186}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9651162790697675, (2, 1): 0.023255813953488372, (2, 2): 0.011627906976744186}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 166.0 -> 167.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 166.0 -> 167.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 188.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=193.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9740932642487047, (2, 1): 0.02072538860103627, (2, 2): 0.0051813471502590676}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9740932642487047, (2, 1): 0.02072538860103627, (2, 2): 0.0051813471502590676}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 188.0}
in get_filtered_urn(filter=0) --- total: total=190.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005263157894736842, (0, 1): 0.005263157894736842, (0, 2): 0.9894736842105263}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005263157894736842, (0, 1): 0.005263157894736842, (0, 2): 0.9894736842105263}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 188.0 -> 189.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 188.0 -> 189.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 167.0}
in get_filtered_urn(filter=0) --- total: total=179.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0111731843575419, (0, 1): 0.055865921787709494, (0, 2): 0.9329608938547486}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0111731843575419, (0, 1): 0.055865921787709494, (0, 2): 0.9329608938547486}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 167.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=173.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9653179190751445, (2, 1): 0.023121387283236993, (2, 2): 0.011560693641618497}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9653179190751445, (2, 1): 0.023121387283236993, (2, 2): 0.011560693641618497}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 167.0 -> 168.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 167.0 -> 168.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 216.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=218.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0045871559633027525, (0, 1): 0.9908256880733946, (0, 2): 0.0045871559633027525}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0045871559633027525, (0, 1): 0.9908256880733946, (0, 2): 0.0045871559633027525}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 216.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=221.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9773755656108597, (1, 1): 0.004524886877828055, (1, 2): 0.01809954751131222}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9773755656108597, (1, 1): 0.004524886877828055, (1, 2): 0.01809954751131222}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 216.0 -> 217.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 216.0 -> 217.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 168.0}
in get_filtered_urn(filter=0) --- total: total=180.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011111111111111112, (0, 1): 0.05555555555555555, (0, 2): 0.9333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011111111111111112, (0, 1): 0.05555555555555555, (0, 2): 0.9333333333333333}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 154.0}
in get_filtered_urn(filter=1) --- total: total=166.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.060240963855421686, (1, 1): 0.012048192771084338, (1, 2): 0.927710843373494}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.060240963855421686, (1, 1): 0.012048192771084338, (1, 2): 0.927710843373494}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 154.0 -> 154.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 217.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=219.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0045662100456621, (0, 1): 0.9908675799086758, (0, 2): 0.0045662100456621}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0045662100456621, (0, 1): 0.9908675799086758, (0, 2): 0.0045662100456621}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 217.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=222.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9774774774774775, (1, 1): 0.0045045045045045045, (1, 2): 0.018018018018018018}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9774774774774775, (1, 1): 0.0045045045045045045, (1, 2): 0.018018018018018018}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 217.0 -> 218.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 217.0 -> 218.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 166.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=172.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9651162790697675, (1, 1): 0.011627906976744186, (1, 2): 0.023255813953488372}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9651162790697675, (1, 1): 0.011627906976744186, (1, 2): 0.023255813953488372}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 166.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=177.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011299435028248588, (0, 1): 0.9378531073446328, (0, 2): 0.05084745762711865}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011299435028248588, (0, 1): 0.9378531073446328, (0, 2): 0.05084745762711865}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 166.0 -> 167.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 166.0 -> 167.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 243.0}
in get_filtered_urn(filter=1) --- total: total=245.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004081632653061225, (1, 1): 0.004081632653061225, (1, 2): 0.9918367346938776}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004081632653061225, (1, 1): 0.004081632653061225, (1, 2): 0.9918367346938776}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 243.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=245.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004081632653061225, (2, 1): 0.9918367346938776, (2, 2): 0.004081632653061225}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004081632653061225, (2, 1): 0.9918367346938776, (2, 2): 0.004081632653061225}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 243.0 -> 244.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 243.0 -> 244.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 168.0}
in get_filtered_urn(filter=0) --- total: total=180.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011111111111111112, (0, 1): 0.05555555555555555, (0, 2): 0.9333333333333333}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.011111111111111112, (0, 1): 0.05555555555555555, (0, 2): 0.9333333333333333}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 168.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=174.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9655172413793104, (2, 1): 0.022988505747126436, (2, 2): 0.011494252873563218}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9655172413793104, (2, 1): 0.022988505747126436, (2, 2): 0.011494252873563218}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 168.0 -> 169.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 168.0 -> 169.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 189.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=194.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9742268041237113, (2, 1): 0.020618556701030927, (2, 2): 0.005154639175257732}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9742268041237113, (2, 1): 0.020618556701030927, (2, 2): 0.005154639175257732}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 189.0}
in get_filtered_urn(filter=0) --- total: total=191.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005235602094240838, (0, 1): 0.005235602094240838, (0, 2): 0.9895287958115183}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005235602094240838, (0, 1): 0.005235602094240838, (0, 2): 0.9895287958115183}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 189.0 -> 190.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 189.0 -> 190.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 154.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=165.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05454545454545454, (2, 1): 0.9333333333333333, (2, 2): 0.012121212121212121}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05454545454545454, (2, 1): 0.9333333333333333, (2, 2): 0.012121212121212121}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 154.0}
in get_filtered_urn(filter=1) --- total: total=166.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.060240963855421686, (1, 1): 0.012048192771084338, (1, 2): 0.927710843373494}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.060240963855421686, (1, 1): 0.012048192771084338, (1, 2): 0.927710843373494}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 154.0 -> 155.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 154.0 -> 155.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 244.0}
in get_filtered_urn(filter=1) --- total: total=246.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0040650406504065045, (1, 1): 0.0040650406504065045, (1, 2): 0.991869918699187}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0040650406504065045, (1, 1): 0.0040650406504065045, (1, 2): 0.991869918699187}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 244.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=246.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0040650406504065045, (2, 1): 0.991869918699187, (2, 2): 0.0040650406504065045}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0040650406504065045, (2, 1): 0.991869918699187, (2, 2): 0.0040650406504065045}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 244.0 -> 245.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 244.0 -> 245.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 155.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=166.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05421686746987952, (2, 1): 0.9337349397590361, (2, 2): 0.012048192771084338}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05421686746987952, (2, 1): 0.9337349397590361, (2, 2): 0.012048192771084338}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 155.0}
in get_filtered_urn(filter=1) --- total: total=167.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.059880239520958084, (1, 1): 0.011976047904191617, (1, 2): 0.9281437125748503}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.059880239520958084, (1, 1): 0.011976047904191617, (1, 2): 0.9281437125748503}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 155.0 -> 156.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 155.0 -> 156.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 190.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=195.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9743589743589743, (2, 1): 0.020512820512820513, (2, 2): 0.005128205128205128}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9743589743589743, (2, 1): 0.020512820512820513, (2, 2): 0.005128205128205128}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 190.0}
in get_filtered_urn(filter=0) --- total: total=192.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005208333333333333, (0, 1): 0.005208333333333333, (0, 2): 0.9895833333333334}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005208333333333333, (0, 1): 0.005208333333333333, (0, 2): 0.9895833333333334}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 190.0 -> 191.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 190.0 -> 191.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 167.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=173.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9653179190751445, (1, 1): 0.011560693641618497, (1, 2): 0.023121387283236993}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9653179190751445, (1, 1): 0.011560693641618497, (1, 2): 0.023121387283236993}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 167.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=178.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011235955056179775, (0, 1): 0.9382022471910112, (0, 2): 0.05056179775280899}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011235955056179775, (0, 1): 0.9382022471910112, (0, 2): 0.05056179775280899}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 167.0 -> 168.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 167.0 -> 168.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 245.0}
in get_filtered_urn(filter=1) --- total: total=247.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004048582995951417, (1, 1): 0.004048582995951417, (1, 2): 0.9919028340080972}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004048582995951417, (1, 1): 0.004048582995951417, (1, 2): 0.9919028340080972}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 245.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=247.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004048582995951417, (2, 1): 0.9919028340080972, (2, 2): 0.004048582995951417}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004048582995951417, (2, 1): 0.9919028340080972, (2, 2): 0.004048582995951417}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 245.0 -> 246.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 245.0 -> 246.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 156.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=167.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05389221556886228, (2, 1): 0.9341317365269461, (2, 2): 0.011976047904191617}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05389221556886228, (2, 1): 0.9341317365269461, (2, 2): 0.011976047904191617}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 156.0}
in get_filtered_urn(filter=1) --- total: total=168.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05952380952380952, (1, 1): 0.011904761904761904, (1, 2): 0.9285714285714286}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05952380952380952, (1, 1): 0.011904761904761904, (1, 2): 0.9285714285714286}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 156.0 -> 157.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 156.0 -> 157.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 218.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=220.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004545454545454545, (0, 1): 0.990909090909091, (0, 2): 0.004545454545454545}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004545454545454545, (0, 1): 0.990909090909091, (0, 2): 0.004545454545454545}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 218.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=223.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9775784753363229, (1, 1): 0.004484304932735426, (1, 2): 0.017937219730941704}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.9775784753363229, (1, 1): 0.004484304932735426, (1, 2): 0.017937219730941704}
in decode_message(signal=1) Receiver 2 got option: (1, 2) and decoded action: 2
Receiver 2 received signals: [1] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 1): 218.0 -> 218.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 157.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=168.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05357142857142857, (2, 1): 0.9345238095238095, (2, 2): 0.011904761904761904}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05357142857142857, (2, 1): 0.9345238095238095, (2, 2): 0.011904761904761904}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 157.0}
in get_filtered_urn(filter=1) --- total: total=169.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05917159763313609, (1, 1): 0.011834319526627219, (1, 2): 0.9289940828402367}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05917159763313609, (1, 1): 0.011834319526627219, (1, 2): 0.9289940828402367}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 157.0 -> 158.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 157.0 -> 158.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 191.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=196.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9744897959183674, (2, 1): 0.02040816326530612, (2, 2): 0.00510204081632653}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9744897959183674, (2, 1): 0.02040816326530612, (2, 2): 0.00510204081632653}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 191.0}
in get_filtered_urn(filter=0) --- total: total=193.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0051813471502590676, (0, 1): 0.0051813471502590676, (0, 2): 0.9896373056994818}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0051813471502590676, (0, 1): 0.0051813471502590676, (0, 2): 0.9896373056994818}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 191.0 -> 192.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 191.0 -> 192.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 158.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=169.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05325443786982249, (2, 1): 0.9349112426035503, (2, 2): 0.011834319526627219}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05325443786982249, (2, 1): 0.9349112426035503, (2, 2): 0.011834319526627219}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 158.0}
in get_filtered_urn(filter=1) --- total: total=170.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.058823529411764705, (1, 1): 0.011764705882352941, (1, 2): 0.9294117647058824}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.058823529411764705, (1, 1): 0.011764705882352941, (1, 2): 0.9294117647058824}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 158.0 -> 159.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 158.0 -> 159.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 192.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=197.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9746192893401016, (2, 1): 0.02030456852791878, (2, 2): 0.005076142131979695}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9746192893401016, (2, 1): 0.02030456852791878, (2, 2): 0.005076142131979695}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 192.0}
in get_filtered_urn(filter=0) --- total: total=194.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005154639175257732, (0, 1): 0.005154639175257732, (0, 2): 0.9896907216494846}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005154639175257732, (0, 1): 0.005154639175257732, (0, 2): 0.9896907216494846}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 192.0 -> 193.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 192.0 -> 193.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 169.0}
in get_filtered_urn(filter=0) --- total: total=181.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011049723756906077, (0, 1): 0.055248618784530384, (0, 2): 0.9337016574585635}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.011049723756906077, (0, 1): 0.055248618784530384, (0, 2): 0.9337016574585635}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 169.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=175.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9657142857142857, (2, 1): 0.022857142857142857, (2, 2): 0.011428571428571429}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9657142857142857, (2, 1): 0.022857142857142857, (2, 2): 0.011428571428571429}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 169.0 -> 170.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 169.0 -> 170.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 193.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=198.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9747474747474747, (2, 1): 0.020202020202020204, (2, 2): 0.005050505050505051}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9747474747474747, (2, 1): 0.020202020202020204, (2, 2): 0.005050505050505051}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 193.0}
in get_filtered_urn(filter=0) --- total: total=195.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005128205128205128, (0, 1): 0.005128205128205128, (0, 2): 0.9897435897435898}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005128205128205128, (0, 1): 0.005128205128205128, (0, 2): 0.9897435897435898}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 193.0 -> 194.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 193.0 -> 194.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 170.0}
in get_filtered_urn(filter=0) --- total: total=182.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01098901098901099, (0, 1): 0.054945054945054944, (0, 2): 0.9340659340659341}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.01098901098901099, (0, 1): 0.054945054945054944, (0, 2): 0.9340659340659341}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 170.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=176.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9659090909090909, (2, 1): 0.022727272727272728, (2, 2): 0.011363636363636364}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9659090909090909, (2, 1): 0.022727272727272728, (2, 2): 0.011363636363636364}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 170.0 -> 171.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 170.0 -> 171.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 246.0}
in get_filtered_urn(filter=1) --- total: total=248.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004032258064516129, (1, 1): 0.004032258064516129, (1, 2): 0.9919354838709677}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004032258064516129, (1, 1): 0.004032258064516129, (1, 2): 0.9919354838709677}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 246.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=248.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004032258064516129, (2, 1): 0.9919354838709677, (2, 2): 0.004032258064516129}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004032258064516129, (2, 1): 0.9919354838709677, (2, 2): 0.004032258064516129}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 246.0 -> 247.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 246.0 -> 247.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 168.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=174.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9655172413793104, (1, 1): 0.011494252873563218, (1, 2): 0.022988505747126436}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9655172413793104, (1, 1): 0.011494252873563218, (1, 2): 0.022988505747126436}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 168.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=179.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0111731843575419, (0, 1): 0.9385474860335196, (0, 2): 0.05027932960893855}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0111731843575419, (0, 1): 0.9385474860335196, (0, 2): 0.05027932960893855}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 168.0 -> 169.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 168.0 -> 169.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 194.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=199.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9748743718592965, (2, 1): 0.020100502512562814, (2, 2): 0.005025125628140704}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9748743718592965, (2, 1): 0.020100502512562814, (2, 2): 0.005025125628140704}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 194.0}
in get_filtered_urn(filter=0) --- total: total=196.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00510204081632653, (0, 1): 0.00510204081632653, (0, 2): 0.9897959183673469}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00510204081632653, (0, 1): 0.00510204081632653, (0, 2): 0.9897959183673469}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 194.0 -> 195.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 194.0 -> 195.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 159.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=170.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.052941176470588235, (2, 1): 0.9352941176470588, (2, 2): 0.011764705882352941}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.052941176470588235, (2, 1): 0.9352941176470588, (2, 2): 0.011764705882352941}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 159.0}
in get_filtered_urn(filter=1) --- total: total=171.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05847953216374269, (1, 1): 0.011695906432748537, (1, 2): 0.9298245614035088}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05847953216374269, (1, 1): 0.011695906432748537, (1, 2): 0.9298245614035088}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 159.0 -> 160.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 159.0 -> 160.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 247.0}
in get_filtered_urn(filter=1) --- total: total=249.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004016064257028112, (1, 1): 0.004016064257028112, (1, 2): 0.9919678714859438}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004016064257028112, (1, 1): 0.004016064257028112, (1, 2): 0.9919678714859438}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 247.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=249.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004016064257028112, (2, 1): 0.9919678714859438, (2, 2): 0.004016064257028112}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004016064257028112, (2, 1): 0.9919678714859438, (2, 2): 0.004016064257028112}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 247.0 -> 248.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 247.0 -> 248.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 171.0}
in get_filtered_urn(filter=0) --- total: total=183.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01092896174863388, (0, 1): 0.0546448087431694, (0, 2): 0.9344262295081968}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.01092896174863388, (0, 1): 0.0546448087431694, (0, 2): 0.9344262295081968}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 171.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=177.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9661016949152542, (2, 1): 0.022598870056497175, (2, 2): 0.011299435028248588}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9661016949152542, (2, 1): 0.022598870056497175, (2, 2): 0.011299435028248588}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 171.0 -> 172.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 171.0 -> 172.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 218.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=220.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004545454545454545, (0, 1): 0.990909090909091, (0, 2): 0.004545454545454545}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004545454545454545, (0, 1): 0.990909090909091, (0, 2): 0.004545454545454545}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 218.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=223.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9775784753363229, (1, 1): 0.004484304932735426, (1, 2): 0.017937219730941704}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9775784753363229, (1, 1): 0.004484304932735426, (1, 2): 0.017937219730941704}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 218.0 -> 219.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 218.0 -> 219.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 169.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=175.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9657142857142857, (1, 1): 0.011428571428571429, (1, 2): 0.022857142857142857}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9657142857142857, (1, 1): 0.011428571428571429, (1, 2): 0.022857142857142857}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 169.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=180.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011111111111111112, (0, 1): 0.9388888888888889, (0, 2): 0.05}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011111111111111112, (0, 1): 0.9388888888888889, (0, 2): 0.05}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 169.0 -> 170.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 169.0 -> 170.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 195.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=200.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.975, (2, 1): 0.02, (2, 2): 0.005}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.975, (2, 1): 0.02, (2, 2): 0.005}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 195.0}
in get_filtered_urn(filter=0) --- total: total=197.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005076142131979695, (0, 1): 0.005076142131979695, (0, 2): 0.9898477157360406}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005076142131979695, (0, 1): 0.005076142131979695, (0, 2): 0.9898477157360406}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 195.0 -> 196.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 195.0 -> 196.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 170.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=176.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9659090909090909, (1, 1): 0.011363636363636364, (1, 2): 0.022727272727272728}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9659090909090909, (1, 1): 0.011363636363636364, (1, 2): 0.022727272727272728}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 170.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=181.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.011049723756906077, (0, 1): 0.9392265193370166, (0, 2): 0.049723756906077346}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.011049723756906077, (0, 1): 0.9392265193370166, (0, 2): 0.049723756906077346}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 170.0 -> 171.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 170.0 -> 171.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 196.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=201.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9751243781094527, (2, 1): 0.01990049751243781, (2, 2): 0.004975124378109453}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9751243781094527, (2, 1): 0.01990049751243781, (2, 2): 0.004975124378109453}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 196.0}
in get_filtered_urn(filter=0) --- total: total=198.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005050505050505051, (0, 1): 0.005050505050505051, (0, 2): 0.98989898989899}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005050505050505051, (0, 1): 0.005050505050505051, (0, 2): 0.98989898989899}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 196.0 -> 197.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 196.0 -> 197.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 160.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=171.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05263157894736842, (2, 1): 0.935672514619883, (2, 2): 0.011695906432748537}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05263157894736842, (2, 1): 0.935672514619883, (2, 2): 0.011695906432748537}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 160.0}
in get_filtered_urn(filter=1) --- total: total=172.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05813953488372093, (1, 1): 0.011627906976744186, (1, 2): 0.9302325581395349}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05813953488372093, (1, 1): 0.011627906976744186, (1, 2): 0.9302325581395349}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 160.0 -> 161.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 160.0 -> 161.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 219.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=221.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004524886877828055, (0, 1): 0.9909502262443439, (0, 2): 0.004524886877828055}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004524886877828055, (0, 1): 0.9909502262443439, (0, 2): 0.004524886877828055}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 219.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=224.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9776785714285714, (1, 1): 0.004464285714285714, (1, 2): 0.017857142857142856}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9776785714285714, (1, 1): 0.004464285714285714, (1, 2): 0.017857142857142856}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 219.0 -> 220.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 219.0 -> 220.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 172.0}
in get_filtered_urn(filter=0) --- total: total=184.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010869565217391304, (0, 1): 0.05434782608695652, (0, 2): 0.9347826086956522}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010869565217391304, (0, 1): 0.05434782608695652, (0, 2): 0.9347826086956522}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 172.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=178.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9662921348314607, (2, 1): 0.02247191011235955, (2, 2): 0.011235955056179775}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9662921348314607, (2, 1): 0.02247191011235955, (2, 2): 0.011235955056179775}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 172.0 -> 173.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 172.0 -> 173.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 248.0}
in get_filtered_urn(filter=1) --- total: total=250.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.004, (1, 1): 0.004, (1, 2): 0.992}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.004, (1, 1): 0.004, (1, 2): 0.992}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 248.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=250.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.004, (2, 1): 0.992, (2, 2): 0.004}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.004, (2, 1): 0.992, (2, 2): 0.004}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 248.0 -> 249.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 248.0 -> 249.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 173.0}
in get_filtered_urn(filter=0) --- total: total=185.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010810810810810811, (0, 1): 0.05405405405405406, (0, 2): 0.9351351351351351}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010810810810810811, (0, 1): 0.05405405405405406, (0, 2): 0.9351351351351351}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 173.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=179.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9664804469273743, (2, 1): 0.0223463687150838, (2, 2): 0.0111731843575419}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9664804469273743, (2, 1): 0.0223463687150838, (2, 2): 0.0111731843575419}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 173.0 -> 174.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 173.0 -> 174.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 197.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=202.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9752475247524752, (2, 1): 0.019801980198019802, (2, 2): 0.0049504950495049506}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9752475247524752, (2, 1): 0.019801980198019802, (2, 2): 0.0049504950495049506}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 197.0}
in get_filtered_urn(filter=0) --- total: total=199.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005025125628140704, (0, 1): 0.005025125628140704, (0, 2): 0.9899497487437185}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005025125628140704, (0, 1): 0.005025125628140704, (0, 2): 0.9899497487437185}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 197.0 -> 198.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 197.0 -> 198.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 161.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=172.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05232558139534884, (2, 1): 0.936046511627907, (2, 2): 0.011627906976744186}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05232558139534884, (2, 1): 0.936046511627907, (2, 2): 0.011627906976744186}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 161.0}
in get_filtered_urn(filter=1) --- total: total=173.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.057803468208092484, (1, 1): 0.011560693641618497, (1, 2): 0.930635838150289}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.057803468208092484, (1, 1): 0.011560693641618497, (1, 2): 0.930635838150289}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 161.0 -> 162.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 161.0 -> 162.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 220.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=222.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0045045045045045045, (0, 1): 0.990990990990991, (0, 2): 0.0045045045045045045}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0045045045045045045, (0, 1): 0.990990990990991, (0, 2): 0.0045045045045045045}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 220.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=225.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9777777777777777, (1, 1): 0.0044444444444444444, (1, 2): 0.017777777777777778}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9777777777777777, (1, 1): 0.0044444444444444444, (1, 2): 0.017777777777777778}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 220.0 -> 221.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 220.0 -> 221.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 174.0}
in get_filtered_urn(filter=0) --- total: total=186.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010752688172043012, (0, 1): 0.053763440860215055, (0, 2): 0.9354838709677419}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010752688172043012, (0, 1): 0.053763440860215055, (0, 2): 0.9354838709677419}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 174.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=180.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9666666666666667, (2, 1): 0.022222222222222223, (2, 2): 0.011111111111111112}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9666666666666667, (2, 1): 0.022222222222222223, (2, 2): 0.011111111111111112}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 174.0 -> 175.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 174.0 -> 175.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 221.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=223.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004484304932735426, (0, 1): 0.9910313901345291, (0, 2): 0.004484304932735426}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004484304932735426, (0, 1): 0.9910313901345291, (0, 2): 0.004484304932735426}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 221.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=226.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9778761061946902, (1, 1): 0.004424778761061947, (1, 2): 0.017699115044247787}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9778761061946902, (1, 1): 0.004424778761061947, (1, 2): 0.017699115044247787}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 221.0 -> 222.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 221.0 -> 222.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 171.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=177.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9661016949152542, (1, 1): 0.011299435028248588, (1, 2): 0.022598870056497175}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9661016949152542, (1, 1): 0.011299435028248588, (1, 2): 0.022598870056497175}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 171.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=182.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01098901098901099, (0, 1): 0.9395604395604396, (0, 2): 0.04945054945054945}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.01098901098901099, (0, 1): 0.9395604395604396, (0, 2): 0.04945054945054945}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 171.0 -> 172.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 171.0 -> 172.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 249.0}
in get_filtered_urn(filter=1) --- total: total=251.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.00398406374501992, (1, 1): 0.00398406374501992, (1, 2): 0.9920318725099602}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.00398406374501992, (1, 1): 0.00398406374501992, (1, 2): 0.9920318725099602}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 249.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=251.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.00398406374501992, (2, 1): 0.9920318725099602, (2, 2): 0.00398406374501992}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.00398406374501992, (2, 1): 0.9920318725099602, (2, 2): 0.00398406374501992}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 249.0 -> 250.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 249.0 -> 250.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 172.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=178.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9662921348314607, (1, 1): 0.011235955056179775, (1, 2): 0.02247191011235955}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9662921348314607, (1, 1): 0.011235955056179775, (1, 2): 0.02247191011235955}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 172.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=183.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01092896174863388, (0, 1): 0.9398907103825137, (0, 2): 0.04918032786885246}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.01092896174863388, (0, 1): 0.9398907103825137, (0, 2): 0.04918032786885246}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 172.0 -> 173.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 172.0 -> 173.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 250.0}
in get_filtered_urn(filter=1) --- total: total=252.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003968253968253968, (1, 1): 0.003968253968253968, (1, 2): 0.9920634920634921}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003968253968253968, (1, 1): 0.003968253968253968, (1, 2): 0.9920634920634921}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 250.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=252.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003968253968253968, (2, 1): 0.9920634920634921, (2, 2): 0.003968253968253968}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003968253968253968, (2, 1): 0.9920634920634921, (2, 2): 0.003968253968253968}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 250.0 -> 251.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 250.0 -> 251.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 175.0}
in get_filtered_urn(filter=0) --- total: total=187.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0106951871657754, (0, 1): 0.053475935828877004, (0, 2): 0.9358288770053476}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0106951871657754, (0, 1): 0.053475935828877004, (0, 2): 0.9358288770053476}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 175.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=181.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9668508287292817, (2, 1): 0.022099447513812154, (2, 2): 0.011049723756906077}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9668508287292817, (2, 1): 0.022099447513812154, (2, 2): 0.011049723756906077}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 175.0 -> 176.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 175.0 -> 176.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 251.0}
in get_filtered_urn(filter=1) --- total: total=253.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003952569169960474, (1, 1): 0.003952569169960474, (1, 2): 0.9920948616600791}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003952569169960474, (1, 1): 0.003952569169960474, (1, 2): 0.9920948616600791}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 251.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=253.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003952569169960474, (2, 1): 0.9920948616600791, (2, 2): 0.003952569169960474}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003952569169960474, (2, 1): 0.9920948616600791, (2, 2): 0.003952569169960474}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 251.0 -> 252.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 251.0 -> 252.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 162.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=173.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05202312138728324, (2, 1): 0.9364161849710982, (2, 2): 0.011560693641618497}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05202312138728324, (2, 1): 0.9364161849710982, (2, 2): 0.011560693641618497}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 162.0}
in get_filtered_urn(filter=1) --- total: total=174.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05747126436781609, (1, 1): 0.011494252873563218, (1, 2): 0.9310344827586207}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05747126436781609, (1, 1): 0.011494252873563218, (1, 2): 0.9310344827586207}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 162.0 -> 163.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 162.0 -> 163.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 252.0}
in get_filtered_urn(filter=1) --- total: total=254.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003937007874015748, (1, 1): 0.003937007874015748, (1, 2): 0.9921259842519685}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003937007874015748, (1, 1): 0.003937007874015748, (1, 2): 0.9921259842519685}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 252.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=254.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003937007874015748, (2, 1): 0.9921259842519685, (2, 2): 0.003937007874015748}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003937007874015748, (2, 1): 0.9921259842519685, (2, 2): 0.003937007874015748}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 252.0 -> 253.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 252.0 -> 253.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 163.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=174.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05172413793103448, (2, 1): 0.9367816091954023, (2, 2): 0.011494252873563218}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05172413793103448, (2, 1): 0.9367816091954023, (2, 2): 0.011494252873563218}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 163.0}
in get_filtered_urn(filter=1) --- total: total=175.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05714285714285714, (1, 1): 0.011428571428571429, (1, 2): 0.9314285714285714}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05714285714285714, (1, 1): 0.011428571428571429, (1, 2): 0.9314285714285714}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 163.0 -> 164.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 163.0 -> 164.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 222.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=224.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004464285714285714, (0, 1): 0.9910714285714286, (0, 2): 0.004464285714285714}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004464285714285714, (0, 1): 0.9910714285714286, (0, 2): 0.004464285714285714}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 222.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=227.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9779735682819384, (1, 1): 0.004405286343612335, (1, 2): 0.01762114537444934}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9779735682819384, (1, 1): 0.004405286343612335, (1, 2): 0.01762114537444934}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 222.0 -> 223.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 222.0 -> 223.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 173.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=179.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9664804469273743, (1, 1): 0.0111731843575419, (1, 2): 0.0223463687150838}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9664804469273743, (1, 1): 0.0111731843575419, (1, 2): 0.0223463687150838}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 173.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=184.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010869565217391304, (0, 1): 0.9402173913043478, (0, 2): 0.04891304347826087}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.010869565217391304, (0, 1): 0.9402173913043478, (0, 2): 0.04891304347826087}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 173.0 -> 174.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 173.0 -> 174.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 253.0}
in get_filtered_urn(filter=1) --- total: total=255.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.00392156862745098, (1, 1): 0.00392156862745098, (1, 2): 0.9921568627450981}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.00392156862745098, (1, 1): 0.00392156862745098, (1, 2): 0.9921568627450981}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 253.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=255.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.00392156862745098, (2, 1): 0.9921568627450981, (2, 2): 0.00392156862745098}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.00392156862745098, (2, 1): 0.9921568627450981, (2, 2): 0.00392156862745098}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 253.0 -> 254.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 253.0 -> 254.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 164.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=175.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05142857142857143, (2, 1): 0.9371428571428572, (2, 2): 0.011428571428571429}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05142857142857143, (2, 1): 0.9371428571428572, (2, 2): 0.011428571428571429}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 164.0}
in get_filtered_urn(filter=1) --- total: total=176.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.056818181818181816, (1, 1): 0.011363636363636364, (1, 2): 0.9318181818181818}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.056818181818181816, (1, 1): 0.011363636363636364, (1, 2): 0.9318181818181818}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 164.0 -> 165.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 164.0 -> 165.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 223.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=225.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0044444444444444444, (0, 1): 0.9911111111111112, (0, 2): 0.0044444444444444444}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0044444444444444444, (0, 1): 0.9911111111111112, (0, 2): 0.0044444444444444444}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 223.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=228.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9780701754385965, (1, 1): 0.0043859649122807015, (1, 2): 0.017543859649122806}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9780701754385965, (1, 1): 0.0043859649122807015, (1, 2): 0.017543859649122806}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 223.0 -> 224.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 223.0 -> 224.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 165.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=176.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05113636363636364, (2, 1): 0.9375, (2, 2): 0.011363636363636364}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05113636363636364, (2, 1): 0.9375, (2, 2): 0.011363636363636364}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 165.0}
in get_filtered_urn(filter=1) --- total: total=177.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05649717514124294, (1, 1): 0.011299435028248588, (1, 2): 0.9322033898305084}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.05649717514124294, (1, 1): 0.011299435028248588, (1, 2): 0.9322033898305084}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 165.0 -> 165.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 224.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=226.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004424778761061947, (0, 1): 0.9911504424778761, (0, 2): 0.004424778761061947}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004424778761061947, (0, 1): 0.9911504424778761, (0, 2): 0.004424778761061947}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 224.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=229.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9781659388646288, (1, 1): 0.004366812227074236, (1, 2): 0.017467248908296942}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9781659388646288, (1, 1): 0.004366812227074236, (1, 2): 0.017467248908296942}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 224.0 -> 225.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 224.0 -> 225.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 174.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=180.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9666666666666667, (1, 1): 0.011111111111111112, (1, 2): 0.022222222222222223}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9666666666666667, (1, 1): 0.011111111111111112, (1, 2): 0.022222222222222223}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 174.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=185.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010810810810810811, (0, 1): 0.9405405405405406, (0, 2): 0.04864864864864865}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.010810810810810811, (0, 1): 0.9405405405405406, (0, 2): 0.04864864864864865}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 174.0 -> 175.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 174.0 -> 175.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 198.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=203.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9753694581280788, (2, 1): 0.019704433497536946, (2, 2): 0.0049261083743842365}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9753694581280788, (2, 1): 0.019704433497536946, (2, 2): 0.0049261083743842365}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 198.0}
in get_filtered_urn(filter=0) --- total: total=200.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.005, (0, 1): 0.005, (0, 2): 0.99}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.005, (0, 1): 0.005, (0, 2): 0.99}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 198.0 -> 199.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 198.0 -> 199.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 175.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=181.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9668508287292817, (1, 1): 0.011049723756906077, (1, 2): 0.022099447513812154}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9668508287292817, (1, 1): 0.011049723756906077, (1, 2): 0.022099447513812154}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 175.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=186.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010752688172043012, (0, 1): 0.9408602150537635, (0, 2): 0.04838709677419355}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010752688172043012, (0, 1): 0.9408602150537635, (0, 2): 0.04838709677419355}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 175.0 -> 175.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 9.0 -> 9.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 254.0}
in get_filtered_urn(filter=1) --- total: total=256.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.00390625, (1, 1): 0.00390625, (1, 2): 0.9921875}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.00390625, (1, 1): 0.00390625, (1, 2): 0.9921875}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 254.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=256.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.00390625, (2, 1): 0.9921875, (2, 2): 0.00390625}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.00390625, (2, 1): 0.9921875, (2, 2): 0.00390625}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 254.0 -> 255.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 254.0 -> 255.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 165.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=176.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05113636363636364, (2, 1): 0.9375, (2, 2): 0.011363636363636364}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05113636363636364, (2, 1): 0.9375, (2, 2): 0.011363636363636364}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 165.0}
in get_filtered_urn(filter=1) --- total: total=177.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05649717514124294, (1, 1): 0.011299435028248588, (1, 2): 0.9322033898305084}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05649717514124294, (1, 1): 0.011299435028248588, (1, 2): 0.9322033898305084}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 165.0 -> 166.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 165.0 -> 166.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 225.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=227.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004405286343612335, (0, 1): 0.9911894273127754, (0, 2): 0.004405286343612335}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004405286343612335, (0, 1): 0.9911894273127754, (0, 2): 0.004405286343612335}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 225.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=230.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9782608695652174, (1, 1): 0.004347826086956522, (1, 2): 0.017391304347826087}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9782608695652174, (1, 1): 0.004347826086956522, (1, 2): 0.017391304347826087}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 225.0 -> 226.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 225.0 -> 226.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 175.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=181.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9668508287292817, (1, 1): 0.011049723756906077, (1, 2): 0.022099447513812154}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9668508287292817, (1, 1): 0.011049723756906077, (1, 2): 0.022099447513812154}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 175.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=186.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010752688172043012, (0, 1): 0.9408602150537635, (0, 2): 0.04838709677419355}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.010752688172043012, (0, 1): 0.9408602150537635, (0, 2): 0.04838709677419355}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 175.0 -> 176.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 175.0 -> 176.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 199.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=204.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9754901960784313, (2, 1): 0.0196078431372549, (2, 2): 0.004901960784313725}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9754901960784313, (2, 1): 0.0196078431372549, (2, 2): 0.004901960784313725}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 199.0}
in get_filtered_urn(filter=0) --- total: total=201.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004975124378109453, (0, 1): 0.004975124378109453, (0, 2): 0.9900497512437811}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004975124378109453, (0, 1): 0.004975124378109453, (0, 2): 0.9900497512437811}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 199.0 -> 200.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 199.0 -> 200.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 176.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=182.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.967032967032967, (1, 1): 0.01098901098901099, (1, 2): 0.02197802197802198}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.967032967032967, (1, 1): 0.01098901098901099, (1, 2): 0.02197802197802198}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 176.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=187.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0106951871657754, (0, 1): 0.9411764705882353, (0, 2): 0.0481283422459893}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0106951871657754, (0, 1): 0.9411764705882353, (0, 2): 0.0481283422459893}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 176.0 -> 177.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 176.0 -> 177.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 255.0}
in get_filtered_urn(filter=1) --- total: total=257.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0038910505836575876, (1, 1): 0.0038910505836575876, (1, 2): 0.9922178988326849}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0038910505836575876, (1, 1): 0.0038910505836575876, (1, 2): 0.9922178988326849}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 255.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=257.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0038910505836575876, (2, 1): 0.9922178988326849, (2, 2): 0.0038910505836575876}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0038910505836575876, (2, 1): 0.9922178988326849, (2, 2): 0.0038910505836575876}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 255.0 -> 256.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 255.0 -> 256.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 177.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=183.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9672131147540983, (1, 1): 0.01092896174863388, (1, 2): 0.02185792349726776}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9672131147540983, (1, 1): 0.01092896174863388, (1, 2): 0.02185792349726776}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 177.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=188.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010638297872340425, (0, 1): 0.9414893617021277, (0, 2): 0.047872340425531915}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.010638297872340425, (0, 1): 0.9414893617021277, (0, 2): 0.047872340425531915}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 177.0 -> 178.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 177.0 -> 178.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 226.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=228.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0043859649122807015, (0, 1): 0.9912280701754386, (0, 2): 0.0043859649122807015}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0043859649122807015, (0, 1): 0.9912280701754386, (0, 2): 0.0043859649122807015}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 226.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=231.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9783549783549783, (1, 1): 0.004329004329004329, (1, 2): 0.017316017316017316}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9783549783549783, (1, 1): 0.004329004329004329, (1, 2): 0.017316017316017316}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 226.0 -> 227.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 226.0 -> 227.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 176.0}
in get_filtered_urn(filter=0) --- total: total=188.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010638297872340425, (0, 1): 0.05319148936170213, (0, 2): 0.9361702127659575}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010638297872340425, (0, 1): 0.05319148936170213, (0, 2): 0.9361702127659575}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 176.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=182.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.967032967032967, (2, 1): 0.02197802197802198, (2, 2): 0.01098901098901099}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.967032967032967, (2, 1): 0.02197802197802198, (2, 2): 0.01098901098901099}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 176.0 -> 177.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 176.0 -> 177.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 256.0}
in get_filtered_urn(filter=1) --- total: total=258.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003875968992248062, (1, 1): 0.003875968992248062, (1, 2): 0.9922480620155039}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003875968992248062, (1, 1): 0.003875968992248062, (1, 2): 0.9922480620155039}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 256.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=258.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003875968992248062, (2, 1): 0.9922480620155039, (2, 2): 0.003875968992248062}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003875968992248062, (2, 1): 0.9922480620155039, (2, 2): 0.003875968992248062}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 256.0 -> 257.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 256.0 -> 257.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 177.0}
in get_filtered_urn(filter=0) --- total: total=189.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010582010582010581, (0, 1): 0.05291005291005291, (0, 2): 0.9365079365079365}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010582010582010581, (0, 1): 0.05291005291005291, (0, 2): 0.9365079365079365}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 177.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=183.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9672131147540983, (2, 1): 0.02185792349726776, (2, 2): 0.01092896174863388}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9672131147540983, (2, 1): 0.02185792349726776, (2, 2): 0.01092896174863388}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 177.0 -> 178.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 177.0 -> 178.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 257.0}
in get_filtered_urn(filter=1) --- total: total=259.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003861003861003861, (1, 1): 0.003861003861003861, (1, 2): 0.9922779922779923}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003861003861003861, (1, 1): 0.003861003861003861, (1, 2): 0.9922779922779923}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 257.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=259.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003861003861003861, (2, 1): 0.9922779922779923, (2, 2): 0.003861003861003861}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003861003861003861, (2, 1): 0.9922779922779923, (2, 2): 0.003861003861003861}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 257.0 -> 258.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 257.0 -> 258.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 178.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=184.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.967391304347826, (1, 1): 0.010869565217391304, (1, 2): 0.021739130434782608}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.967391304347826, (1, 1): 0.010869565217391304, (1, 2): 0.021739130434782608}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 178.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=189.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010582010582010581, (0, 1): 0.9417989417989417, (0, 2): 0.047619047619047616}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.010582010582010581, (0, 1): 0.9417989417989417, (0, 2): 0.047619047619047616}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 178.0 -> 179.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 178.0 -> 179.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 227.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=229.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004366812227074236, (0, 1): 0.9912663755458515, (0, 2): 0.004366812227074236}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004366812227074236, (0, 1): 0.9912663755458515, (0, 2): 0.004366812227074236}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 227.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=232.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.978448275862069, (1, 1): 0.004310344827586207, (1, 2): 0.017241379310344827}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.978448275862069, (1, 1): 0.004310344827586207, (1, 2): 0.017241379310344827}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 227.0 -> 228.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 227.0 -> 228.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 178.0}
in get_filtered_urn(filter=0) --- total: total=190.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010526315789473684, (0, 1): 0.05263157894736842, (0, 2): 0.9368421052631579}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010526315789473684, (0, 1): 0.05263157894736842, (0, 2): 0.9368421052631579}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 178.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=184.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.967391304347826, (2, 1): 0.021739130434782608, (2, 2): 0.010869565217391304}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.967391304347826, (2, 1): 0.021739130434782608, (2, 2): 0.010869565217391304}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 178.0 -> 179.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 178.0 -> 179.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 228.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=230.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004347826086956522, (0, 1): 0.991304347826087, (0, 2): 0.004347826086956522}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004347826086956522, (0, 1): 0.991304347826087, (0, 2): 0.004347826086956522}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 228.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=233.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9785407725321889, (1, 1): 0.004291845493562232, (1, 2): 0.017167381974248927}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9785407725321889, (1, 1): 0.004291845493562232, (1, 2): 0.017167381974248927}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 228.0 -> 229.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 228.0 -> 229.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 166.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=177.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05084745762711865, (2, 1): 0.9378531073446328, (2, 2): 0.011299435028248588}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05084745762711865, (2, 1): 0.9378531073446328, (2, 2): 0.011299435028248588}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 166.0}
in get_filtered_urn(filter=1) --- total: total=178.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.056179775280898875, (1, 1): 0.011235955056179775, (1, 2): 0.9325842696629213}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.056179775280898875, (1, 1): 0.011235955056179775, (1, 2): 0.9325842696629213}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 166.0 -> 167.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 166.0 -> 167.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 200.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=205.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.975609756097561, (2, 1): 0.01951219512195122, (2, 2): 0.004878048780487805}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.975609756097561, (2, 1): 0.01951219512195122, (2, 2): 0.004878048780487805}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 200.0}
in get_filtered_urn(filter=0) --- total: total=202.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0049504950495049506, (0, 1): 0.0049504950495049506, (0, 2): 0.9900990099009901}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0049504950495049506, (0, 1): 0.0049504950495049506, (0, 2): 0.9900990099009901}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 200.0 -> 201.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 200.0 -> 201.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 179.0}
in get_filtered_urn(filter=0) --- total: total=191.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010471204188481676, (0, 1): 0.05235602094240838, (0, 2): 0.93717277486911}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010471204188481676, (0, 1): 0.05235602094240838, (0, 2): 0.93717277486911}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 179.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=185.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9675675675675676, (2, 1): 0.021621621621621623, (2, 2): 0.010810810810810811}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9675675675675676, (2, 1): 0.021621621621621623, (2, 2): 0.010810810810810811}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 179.0 -> 180.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 179.0 -> 180.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 201.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=206.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9757281553398058, (2, 1): 0.019417475728155338, (2, 2): 0.0048543689320388345}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9757281553398058, (2, 1): 0.019417475728155338, (2, 2): 0.0048543689320388345}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 201.0}
in get_filtered_urn(filter=0) --- total: total=203.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0049261083743842365, (0, 1): 0.0049261083743842365, (0, 2): 0.9901477832512315}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0049261083743842365, (0, 1): 0.0049261083743842365, (0, 2): 0.9901477832512315}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 201.0 -> 202.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 201.0 -> 202.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 167.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=178.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05056179775280899, (2, 1): 0.9382022471910112, (2, 2): 0.011235955056179775}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05056179775280899, (2, 1): 0.9382022471910112, (2, 2): 0.011235955056179775}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 167.0}
in get_filtered_urn(filter=1) --- total: total=179.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.055865921787709494, (1, 1): 0.0111731843575419, (1, 2): 0.9329608938547486}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.055865921787709494, (1, 1): 0.0111731843575419, (1, 2): 0.9329608938547486}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 167.0 -> 168.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 167.0 -> 168.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 202.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=207.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9758454106280193, (2, 1): 0.01932367149758454, (2, 2): 0.004830917874396135}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9758454106280193, (2, 1): 0.01932367149758454, (2, 2): 0.004830917874396135}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 202.0}
in get_filtered_urn(filter=0) --- total: total=204.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004901960784313725, (0, 1): 0.004901960784313725, (0, 2): 0.9901960784313726}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004901960784313725, (0, 1): 0.004901960784313725, (0, 2): 0.9901960784313726}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 202.0 -> 203.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 202.0 -> 203.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 168.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=179.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05027932960893855, (2, 1): 0.9385474860335196, (2, 2): 0.0111731843575419}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05027932960893855, (2, 1): 0.9385474860335196, (2, 2): 0.0111731843575419}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 168.0}
in get_filtered_urn(filter=1) --- total: total=180.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05555555555555555, (1, 1): 0.011111111111111112, (1, 2): 0.9333333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05555555555555555, (1, 1): 0.011111111111111112, (1, 2): 0.9333333333333333}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 168.0 -> 169.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 168.0 -> 169.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 203.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=208.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9759615384615384, (2, 1): 0.019230769230769232, (2, 2): 0.004807692307692308}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9759615384615384, (2, 1): 0.019230769230769232, (2, 2): 0.004807692307692308}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 203.0}
in get_filtered_urn(filter=0) --- total: total=205.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004878048780487805, (0, 1): 0.004878048780487805, (0, 2): 0.9902439024390244}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004878048780487805, (0, 1): 0.004878048780487805, (0, 2): 0.9902439024390244}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 203.0 -> 204.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 203.0 -> 204.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 179.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=185.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9675675675675676, (1, 1): 0.010810810810810811, (1, 2): 0.021621621621621623}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9675675675675676, (1, 1): 0.010810810810810811, (1, 2): 0.021621621621621623}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 179.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=190.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010526315789473684, (0, 1): 0.9421052631578948, (0, 2): 0.04736842105263158}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.010526315789473684, (0, 1): 0.9421052631578948, (0, 2): 0.04736842105263158}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 179.0 -> 180.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 179.0 -> 180.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 258.0}
in get_filtered_urn(filter=1) --- total: total=260.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0038461538461538464, (1, 1): 0.0038461538461538464, (1, 2): 0.9923076923076923}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0038461538461538464, (1, 1): 0.0038461538461538464, (1, 2): 0.9923076923076923}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 258.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=260.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0038461538461538464, (2, 1): 0.9923076923076923, (2, 2): 0.0038461538461538464}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0038461538461538464, (2, 1): 0.9923076923076923, (2, 2): 0.0038461538461538464}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 258.0 -> 259.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 258.0 -> 259.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 180.0}
in get_filtered_urn(filter=0) --- total: total=192.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010416666666666666, (0, 1): 0.052083333333333336, (0, 2): 0.9375}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010416666666666666, (0, 1): 0.052083333333333336, (0, 2): 0.9375}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 180.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=186.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.967741935483871, (2, 1): 0.021505376344086023, (2, 2): 0.010752688172043012}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.967741935483871, (2, 1): 0.021505376344086023, (2, 2): 0.010752688172043012}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 180.0 -> 181.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 180.0 -> 181.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 204.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=209.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9760765550239234, (2, 1): 0.019138755980861243, (2, 2): 0.004784688995215311}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9760765550239234, (2, 1): 0.019138755980861243, (2, 2): 0.004784688995215311}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 204.0}
in get_filtered_urn(filter=0) --- total: total=206.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0048543689320388345, (0, 1): 0.0048543689320388345, (0, 2): 0.9902912621359223}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0048543689320388345, (0, 1): 0.0048543689320388345, (0, 2): 0.9902912621359223}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 204.0 -> 205.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 204.0 -> 205.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 180.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=186.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.967741935483871, (1, 1): 0.010752688172043012, (1, 2): 0.021505376344086023}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.967741935483871, (1, 1): 0.010752688172043012, (1, 2): 0.021505376344086023}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 180.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=191.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010471204188481676, (0, 1): 0.9424083769633508, (0, 2): 0.04712041884816754}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.010471204188481676, (0, 1): 0.9424083769633508, (0, 2): 0.04712041884816754}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 180.0 -> 181.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 180.0 -> 181.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 229.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=231.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004329004329004329, (0, 1): 0.9913419913419913, (0, 2): 0.004329004329004329}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004329004329004329, (0, 1): 0.9913419913419913, (0, 2): 0.004329004329004329}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 229.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=234.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9786324786324786, (1, 1): 0.004273504273504274, (1, 2): 0.017094017094017096}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9786324786324786, (1, 1): 0.004273504273504274, (1, 2): 0.017094017094017096}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 229.0 -> 230.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 229.0 -> 230.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 181.0}
in get_filtered_urn(filter=0) --- total: total=193.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010362694300518135, (0, 1): 0.05181347150259067, (0, 2): 0.9378238341968912}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010362694300518135, (0, 1): 0.05181347150259067, (0, 2): 0.9378238341968912}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 181.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=187.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9679144385026738, (2, 1): 0.0213903743315508, (2, 2): 0.0106951871657754}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9679144385026738, (2, 1): 0.0213903743315508, (2, 2): 0.0106951871657754}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 181.0 -> 182.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 181.0 -> 182.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 205.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=210.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9761904761904762, (2, 1): 0.01904761904761905, (2, 2): 0.004761904761904762}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9761904761904762, (2, 1): 0.01904761904761905, (2, 2): 0.004761904761904762}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 205.0}
in get_filtered_urn(filter=0) --- total: total=207.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004830917874396135, (0, 1): 0.004830917874396135, (0, 2): 0.9903381642512077}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004830917874396135, (0, 1): 0.004830917874396135, (0, 2): 0.9903381642512077}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 205.0 -> 206.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 205.0 -> 206.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 182.0}
in get_filtered_urn(filter=0) --- total: total=194.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010309278350515464, (0, 1): 0.05154639175257732, (0, 2): 0.9381443298969072}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010309278350515464, (0, 1): 0.05154639175257732, (0, 2): 0.9381443298969072}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 182.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=188.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9680851063829787, (2, 1): 0.02127659574468085, (2, 2): 0.010638297872340425}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9680851063829787, (2, 1): 0.02127659574468085, (2, 2): 0.010638297872340425}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 182.0 -> 183.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 182.0 -> 183.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 230.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=232.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004310344827586207, (0, 1): 0.9913793103448276, (0, 2): 0.004310344827586207}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004310344827586207, (0, 1): 0.9913793103448276, (0, 2): 0.004310344827586207}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 230.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=235.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9787234042553191, (1, 1): 0.00425531914893617, (1, 2): 0.01702127659574468}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9787234042553191, (1, 1): 0.00425531914893617, (1, 2): 0.01702127659574468}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 230.0 -> 231.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 230.0 -> 231.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 181.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=187.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9679144385026738, (1, 1): 0.0106951871657754, (1, 2): 0.0213903743315508}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9679144385026738, (1, 1): 0.0106951871657754, (1, 2): 0.0213903743315508}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 181.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=192.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010416666666666666, (0, 1): 0.9427083333333334, (0, 2): 0.046875}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.010416666666666666, (0, 1): 0.9427083333333334, (0, 2): 0.046875}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 181.0 -> 182.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 181.0 -> 182.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 206.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=211.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.976303317535545, (2, 1): 0.018957345971563982, (2, 2): 0.004739336492890996}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.976303317535545, (2, 1): 0.018957345971563982, (2, 2): 0.004739336492890996}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 206.0}
in get_filtered_urn(filter=0) --- total: total=208.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004807692307692308, (0, 1): 0.004807692307692308, (0, 2): 0.9903846153846154}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004807692307692308, (0, 1): 0.004807692307692308, (0, 2): 0.9903846153846154}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 206.0 -> 207.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 206.0 -> 207.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 183.0}
in get_filtered_urn(filter=0) --- total: total=195.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010256410256410256, (0, 1): 0.05128205128205128, (0, 2): 0.9384615384615385}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010256410256410256, (0, 1): 0.05128205128205128, (0, 2): 0.9384615384615385}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 183.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=189.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9682539682539683, (2, 1): 0.021164021164021163, (2, 2): 0.010582010582010581}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9682539682539683, (2, 1): 0.021164021164021163, (2, 2): 0.010582010582010581}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 183.0 -> 184.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 183.0 -> 184.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 259.0}
in get_filtered_urn(filter=1) --- total: total=261.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0038314176245210726, (1, 1): 0.0038314176245210726, (1, 2): 0.9923371647509579}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0038314176245210726, (1, 1): 0.0038314176245210726, (1, 2): 0.9923371647509579}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 259.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=261.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0038314176245210726, (2, 1): 0.9923371647509579, (2, 2): 0.0038314176245210726}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0038314176245210726, (2, 1): 0.9923371647509579, (2, 2): 0.0038314176245210726}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 259.0 -> 260.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 259.0 -> 260.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 182.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=188.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9680851063829787, (1, 1): 0.010638297872340425, (1, 2): 0.02127659574468085}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9680851063829787, (1, 1): 0.010638297872340425, (1, 2): 0.02127659574468085}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 182.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=193.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010362694300518135, (0, 1): 0.9430051813471503, (0, 2): 0.046632124352331605}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.010362694300518135, (0, 1): 0.9430051813471503, (0, 2): 0.046632124352331605}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 182.0 -> 183.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 182.0 -> 183.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 207.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=212.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9764150943396226, (2, 1): 0.018867924528301886, (2, 2): 0.0047169811320754715}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9764150943396226, (2, 1): 0.018867924528301886, (2, 2): 0.0047169811320754715}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 207.0}
in get_filtered_urn(filter=0) --- total: total=209.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004784688995215311, (0, 1): 0.004784688995215311, (0, 2): 0.9904306220095693}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004784688995215311, (0, 1): 0.004784688995215311, (0, 2): 0.9904306220095693}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 207.0 -> 208.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 207.0 -> 208.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 184.0}
in get_filtered_urn(filter=0) --- total: total=196.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01020408163265306, (0, 1): 0.05102040816326531, (0, 2): 0.9387755102040817}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.01020408163265306, (0, 1): 0.05102040816326531, (0, 2): 0.9387755102040817}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 184.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=190.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.968421052631579, (2, 1): 0.021052631578947368, (2, 2): 0.010526315789473684}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 2) from urn={(2, 0): 0.968421052631579, (2, 1): 0.021052631578947368, (2, 2): 0.010526315789473684}
in decode_message(signal=2) Receiver 5 got option: (2, 2) and decoded action: 2
Receiver 5 received signals: [2] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 2): 184.0 -> 184.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 2): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 231.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=233.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004291845493562232, (0, 1): 0.9914163090128756, (0, 2): 0.004291845493562232}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004291845493562232, (0, 1): 0.9914163090128756, (0, 2): 0.004291845493562232}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 231.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=236.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9788135593220338, (1, 1): 0.00423728813559322, (1, 2): 0.01694915254237288}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9788135593220338, (1, 1): 0.00423728813559322, (1, 2): 0.01694915254237288}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 231.0 -> 232.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 231.0 -> 232.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 184.0}
in get_filtered_urn(filter=0) --- total: total=196.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01020408163265306, (0, 1): 0.05102040816326531, (0, 2): 0.9387755102040817}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.01020408163265306, (0, 1): 0.05102040816326531, (0, 2): 0.9387755102040817}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 184.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=190.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.968421052631579, (2, 1): 0.021052631578947368, (2, 2): 0.010526315789473684}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.968421052631579, (2, 1): 0.021052631578947368, (2, 2): 0.010526315789473684}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 184.0 -> 185.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 184.0 -> 185.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 260.0}
in get_filtered_urn(filter=1) --- total: total=262.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003816793893129771, (1, 1): 0.003816793893129771, (1, 2): 0.9923664122137404}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003816793893129771, (1, 1): 0.003816793893129771, (1, 2): 0.9923664122137404}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 260.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=262.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003816793893129771, (2, 1): 0.9923664122137404, (2, 2): 0.003816793893129771}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003816793893129771, (2, 1): 0.9923664122137404, (2, 2): 0.003816793893129771}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 260.0 -> 261.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 260.0 -> 261.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 185.0}
in get_filtered_urn(filter=0) --- total: total=197.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01015228426395939, (0, 1): 0.050761421319796954, (0, 2): 0.9390862944162437}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.01015228426395939, (0, 1): 0.050761421319796954, (0, 2): 0.9390862944162437}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 185.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=191.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9685863874345549, (2, 1): 0.020942408376963352, (2, 2): 0.010471204188481676}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9685863874345549, (2, 1): 0.020942408376963352, (2, 2): 0.010471204188481676}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 185.0 -> 186.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 185.0 -> 186.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 261.0}
in get_filtered_urn(filter=1) --- total: total=263.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0038022813688212928, (1, 1): 0.0038022813688212928, (1, 2): 0.9923954372623575}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0038022813688212928, (1, 1): 0.0038022813688212928, (1, 2): 0.9923954372623575}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 261.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=263.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0038022813688212928, (2, 1): 0.9923954372623575, (2, 2): 0.0038022813688212928}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0038022813688212928, (2, 1): 0.9923954372623575, (2, 2): 0.0038022813688212928}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 261.0 -> 262.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 261.0 -> 262.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 186.0}
in get_filtered_urn(filter=0) --- total: total=198.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010101010101010102, (0, 1): 0.050505050505050504, (0, 2): 0.9393939393939394}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010101010101010102, (0, 1): 0.050505050505050504, (0, 2): 0.9393939393939394}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 186.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=192.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.96875, (2, 1): 0.020833333333333332, (2, 2): 0.010416666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.96875, (2, 1): 0.020833333333333332, (2, 2): 0.010416666666666666}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 186.0 -> 187.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 186.0 -> 187.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 262.0}
in get_filtered_urn(filter=1) --- total: total=264.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003787878787878788, (1, 1): 0.003787878787878788, (1, 2): 0.9924242424242424}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003787878787878788, (1, 1): 0.003787878787878788, (1, 2): 0.9924242424242424}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 262.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=264.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003787878787878788, (2, 1): 0.9924242424242424, (2, 2): 0.003787878787878788}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003787878787878788, (2, 1): 0.9924242424242424, (2, 2): 0.003787878787878788}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 262.0 -> 263.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 262.0 -> 263.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 187.0}
in get_filtered_urn(filter=0) --- total: total=199.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010050251256281407, (0, 1): 0.05025125628140704, (0, 2): 0.9396984924623115}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010050251256281407, (0, 1): 0.05025125628140704, (0, 2): 0.9396984924623115}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 187.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=193.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9689119170984456, (2, 1): 0.02072538860103627, (2, 2): 0.010362694300518135}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9689119170984456, (2, 1): 0.02072538860103627, (2, 2): 0.010362694300518135}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 187.0 -> 188.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 187.0 -> 188.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 263.0}
in get_filtered_urn(filter=1) --- total: total=265.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0037735849056603774, (1, 1): 0.0037735849056603774, (1, 2): 0.9924528301886792}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0037735849056603774, (1, 1): 0.0037735849056603774, (1, 2): 0.9924528301886792}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 263.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=265.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0037735849056603774, (2, 1): 0.9924528301886792, (2, 2): 0.0037735849056603774}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0037735849056603774, (2, 1): 0.9924528301886792, (2, 2): 0.0037735849056603774}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 263.0 -> 264.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 263.0 -> 264.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 169.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=180.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.05, (2, 1): 0.9388888888888889, (2, 2): 0.011111111111111112}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.05, (2, 1): 0.9388888888888889, (2, 2): 0.011111111111111112}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 169.0}
in get_filtered_urn(filter=1) --- total: total=181.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.055248618784530384, (1, 1): 0.011049723756906077, (1, 2): 0.9337016574585635}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.055248618784530384, (1, 1): 0.011049723756906077, (1, 2): 0.9337016574585635}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 169.0 -> 170.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 169.0 -> 170.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 264.0}
in get_filtered_urn(filter=1) --- total: total=266.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0037593984962406013, (1, 1): 0.0037593984962406013, (1, 2): 0.9924812030075187}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0037593984962406013, (1, 1): 0.0037593984962406013, (1, 2): 0.9924812030075187}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 264.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=266.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0037593984962406013, (2, 1): 0.9924812030075187, (2, 2): 0.0037593984962406013}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0037593984962406013, (2, 1): 0.9924812030075187, (2, 2): 0.0037593984962406013}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 264.0 -> 265.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 264.0 -> 265.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 183.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=189.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9682539682539683, (1, 1): 0.010582010582010581, (1, 2): 0.021164021164021163}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9682539682539683, (1, 1): 0.010582010582010581, (1, 2): 0.021164021164021163}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 183.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=194.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010309278350515464, (0, 1): 0.9432989690721649, (0, 2): 0.04639175257731959}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.010309278350515464, (0, 1): 0.9432989690721649, (0, 2): 0.04639175257731959}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 183.0 -> 184.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 183.0 -> 184.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 208.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=213.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9765258215962441, (2, 1): 0.018779342723004695, (2, 2): 0.004694835680751174}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9765258215962441, (2, 1): 0.018779342723004695, (2, 2): 0.004694835680751174}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 208.0}
in get_filtered_urn(filter=0) --- total: total=210.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004761904761904762, (0, 1): 0.004761904761904762, (0, 2): 0.9904761904761905}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004761904761904762, (0, 1): 0.004761904761904762, (0, 2): 0.9904761904761905}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 208.0 -> 209.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 208.0 -> 209.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 188.0}
in get_filtered_urn(filter=0) --- total: total=200.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01, (0, 1): 0.05, (0, 2): 0.94}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.01, (0, 1): 0.05, (0, 2): 0.94}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 188.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=194.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9690721649484536, (2, 1): 0.020618556701030927, (2, 2): 0.010309278350515464}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9690721649484536, (2, 1): 0.020618556701030927, (2, 2): 0.010309278350515464}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 188.0 -> 189.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 188.0 -> 189.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 232.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=234.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004273504273504274, (0, 1): 0.9914529914529915, (0, 2): 0.004273504273504274}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004273504273504274, (0, 1): 0.9914529914529915, (0, 2): 0.004273504273504274}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 232.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=237.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9789029535864979, (1, 1): 0.004219409282700422, (1, 2): 0.016877637130801686}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9789029535864979, (1, 1): 0.004219409282700422, (1, 2): 0.016877637130801686}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 232.0 -> 233.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 232.0 -> 233.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 170.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=181.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.049723756906077346, (2, 1): 0.9392265193370166, (2, 2): 0.011049723756906077}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.049723756906077346, (2, 1): 0.9392265193370166, (2, 2): 0.011049723756906077}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 170.0}
in get_filtered_urn(filter=1) --- total: total=182.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.054945054945054944, (1, 1): 0.01098901098901099, (1, 2): 0.9340659340659341}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.054945054945054944, (1, 1): 0.01098901098901099, (1, 2): 0.9340659340659341}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 170.0 -> 171.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 170.0 -> 171.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 265.0}
in get_filtered_urn(filter=1) --- total: total=267.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003745318352059925, (1, 1): 0.003745318352059925, (1, 2): 0.9925093632958801}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003745318352059925, (1, 1): 0.003745318352059925, (1, 2): 0.9925093632958801}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 265.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=267.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003745318352059925, (2, 1): 0.9925093632958801, (2, 2): 0.003745318352059925}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003745318352059925, (2, 1): 0.9925093632958801, (2, 2): 0.003745318352059925}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 265.0 -> 266.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 265.0 -> 266.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 171.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=182.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04945054945054945, (2, 1): 0.9395604395604396, (2, 2): 0.01098901098901099}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04945054945054945, (2, 1): 0.9395604395604396, (2, 2): 0.01098901098901099}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 171.0}
in get_filtered_urn(filter=1) --- total: total=183.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0546448087431694, (1, 1): 0.01092896174863388, (1, 2): 0.9344262295081968}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0546448087431694, (1, 1): 0.01092896174863388, (1, 2): 0.9344262295081968}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 171.0 -> 172.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 171.0 -> 172.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 209.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=214.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9766355140186916, (2, 1): 0.018691588785046728, (2, 2): 0.004672897196261682}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9766355140186916, (2, 1): 0.018691588785046728, (2, 2): 0.004672897196261682}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 209.0}
in get_filtered_urn(filter=0) --- total: total=211.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004739336492890996, (0, 1): 0.004739336492890996, (0, 2): 0.990521327014218}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004739336492890996, (0, 1): 0.004739336492890996, (0, 2): 0.990521327014218}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 209.0 -> 210.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 209.0 -> 210.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 184.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=190.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.968421052631579, (1, 1): 0.010526315789473684, (1, 2): 0.021052631578947368}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.968421052631579, (1, 1): 0.010526315789473684, (1, 2): 0.021052631578947368}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 184.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=195.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010256410256410256, (0, 1): 0.9435897435897436, (0, 2): 0.046153846153846156}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010256410256410256, (0, 1): 0.9435897435897436, (0, 2): 0.046153846153846156}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 184.0 -> 184.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 9.0 -> 9.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 210.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=215.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9767441860465116, (2, 1): 0.018604651162790697, (2, 2): 0.004651162790697674}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9767441860465116, (2, 1): 0.018604651162790697, (2, 2): 0.004651162790697674}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 210.0}
in get_filtered_urn(filter=0) --- total: total=212.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0047169811320754715, (0, 1): 0.0047169811320754715, (0, 2): 0.9905660377358491}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0047169811320754715, (0, 1): 0.0047169811320754715, (0, 2): 0.9905660377358491}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 210.0 -> 211.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 210.0 -> 211.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 184.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=190.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.968421052631579, (1, 1): 0.010526315789473684, (1, 2): 0.021052631578947368}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.968421052631579, (1, 1): 0.010526315789473684, (1, 2): 0.021052631578947368}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 184.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=195.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010256410256410256, (0, 1): 0.9435897435897436, (0, 2): 0.046153846153846156}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.010256410256410256, (0, 1): 0.9435897435897436, (0, 2): 0.046153846153846156}
in decode_message(signal=0) Receiver 5 got option: (0, 2) and decoded action: 2
Receiver 5 received signals: [0] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 184.0 -> 184.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 2): 9.0 -> 9.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 233.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=235.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00425531914893617, (0, 1): 0.9914893617021276, (0, 2): 0.00425531914893617}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00425531914893617, (0, 1): 0.9914893617021276, (0, 2): 0.00425531914893617}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 233.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=238.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9789915966386554, (1, 1): 0.004201680672268907, (1, 2): 0.01680672268907563}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9789915966386554, (1, 1): 0.004201680672268907, (1, 2): 0.01680672268907563}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 233.0 -> 234.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 233.0 -> 234.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 189.0}
in get_filtered_urn(filter=0) --- total: total=201.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009950248756218905, (0, 1): 0.04975124378109453, (0, 2): 0.9402985074626866}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009950248756218905, (0, 1): 0.04975124378109453, (0, 2): 0.9402985074626866}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 189.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=195.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9692307692307692, (2, 1): 0.020512820512820513, (2, 2): 0.010256410256410256}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9692307692307692, (2, 1): 0.020512820512820513, (2, 2): 0.010256410256410256}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 189.0 -> 190.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 189.0 -> 190.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 211.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=216.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9768518518518519, (2, 1): 0.018518518518518517, (2, 2): 0.004629629629629629}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9768518518518519, (2, 1): 0.018518518518518517, (2, 2): 0.004629629629629629}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 211.0}
in get_filtered_urn(filter=0) --- total: total=213.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004694835680751174, (0, 1): 0.004694835680751174, (0, 2): 0.9906103286384976}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004694835680751174, (0, 1): 0.004694835680751174, (0, 2): 0.9906103286384976}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 211.0 -> 212.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 211.0 -> 212.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 172.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=183.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04918032786885246, (2, 1): 0.9398907103825137, (2, 2): 0.01092896174863388}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04918032786885246, (2, 1): 0.9398907103825137, (2, 2): 0.01092896174863388}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 172.0}
in get_filtered_urn(filter=1) --- total: total=184.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05434782608695652, (1, 1): 0.010869565217391304, (1, 2): 0.9347826086956522}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05434782608695652, (1, 1): 0.010869565217391304, (1, 2): 0.9347826086956522}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 172.0 -> 173.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 172.0 -> 173.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 234.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=236.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00423728813559322, (0, 1): 0.9915254237288136, (0, 2): 0.00423728813559322}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00423728813559322, (0, 1): 0.9915254237288136, (0, 2): 0.00423728813559322}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 234.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=239.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9790794979079498, (1, 1): 0.0041841004184100415, (1, 2): 0.016736401673640166}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9790794979079498, (1, 1): 0.0041841004184100415, (1, 2): 0.016736401673640166}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 234.0 -> 235.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 234.0 -> 235.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 173.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=184.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04891304347826087, (2, 1): 0.9402173913043478, (2, 2): 0.010869565217391304}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04891304347826087, (2, 1): 0.9402173913043478, (2, 2): 0.010869565217391304}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 173.0}
in get_filtered_urn(filter=1) --- total: total=185.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05405405405405406, (1, 1): 0.010810810810810811, (1, 2): 0.9351351351351351}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05405405405405406, (1, 1): 0.010810810810810811, (1, 2): 0.9351351351351351}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 173.0 -> 174.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 173.0 -> 174.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 212.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=217.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9769585253456221, (2, 1): 0.018433179723502304, (2, 2): 0.004608294930875576}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9769585253456221, (2, 1): 0.018433179723502304, (2, 2): 0.004608294930875576}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 212.0}
in get_filtered_urn(filter=0) --- total: total=214.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004672897196261682, (0, 1): 0.004672897196261682, (0, 2): 0.9906542056074766}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004672897196261682, (0, 1): 0.004672897196261682, (0, 2): 0.9906542056074766}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 212.0 -> 213.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 212.0 -> 213.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 184.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=190.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.968421052631579, (1, 1): 0.010526315789473684, (1, 2): 0.021052631578947368}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.968421052631579, (1, 1): 0.010526315789473684, (1, 2): 0.021052631578947368}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 184.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=195.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010256410256410256, (0, 1): 0.9435897435897436, (0, 2): 0.046153846153846156}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.010256410256410256, (0, 1): 0.9435897435897436, (0, 2): 0.046153846153846156}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 184.0 -> 185.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 184.0 -> 185.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 213.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=218.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9770642201834863, (2, 1): 0.01834862385321101, (2, 2): 0.0045871559633027525}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9770642201834863, (2, 1): 0.01834862385321101, (2, 2): 0.0045871559633027525}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 213.0}
in get_filtered_urn(filter=0) --- total: total=215.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004651162790697674, (0, 1): 0.004651162790697674, (0, 2): 0.9906976744186047}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004651162790697674, (0, 1): 0.004651162790697674, (0, 2): 0.9906976744186047}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 213.0 -> 214.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 213.0 -> 214.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 174.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=185.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04864864864864865, (2, 1): 0.9405405405405406, (2, 2): 0.010810810810810811}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.04864864864864865, (2, 1): 0.9405405405405406, (2, 2): 0.010810810810810811}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 185.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=196.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01020408163265306, (0, 1): 0.9438775510204082, (0, 2): 0.04591836734693878}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.01020408163265306, (0, 1): 0.9438775510204082, (0, 2): 0.04591836734693878}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 9.0 -> 9.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 185.0 -> 185.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 235.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=237.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004219409282700422, (0, 1): 0.9915611814345991, (0, 2): 0.004219409282700422}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004219409282700422, (0, 1): 0.9915611814345991, (0, 2): 0.004219409282700422}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 235.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=240.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9791666666666666, (1, 1): 0.004166666666666667, (1, 2): 0.016666666666666666}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9791666666666666, (1, 1): 0.004166666666666667, (1, 2): 0.016666666666666666}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 235.0 -> 236.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 235.0 -> 236.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 174.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=185.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04864864864864865, (2, 1): 0.9405405405405406, (2, 2): 0.010810810810810811}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04864864864864865, (2, 1): 0.9405405405405406, (2, 2): 0.010810810810810811}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 174.0}
in get_filtered_urn(filter=1) --- total: total=186.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.053763440860215055, (1, 1): 0.010752688172043012, (1, 2): 0.9354838709677419}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.053763440860215055, (1, 1): 0.010752688172043012, (1, 2): 0.9354838709677419}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 174.0 -> 175.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 174.0 -> 175.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 266.0}
in get_filtered_urn(filter=1) --- total: total=268.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0037313432835820895, (1, 1): 0.0037313432835820895, (1, 2): 0.9925373134328358}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0037313432835820895, (1, 1): 0.0037313432835820895, (1, 2): 0.9925373134328358}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 266.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=268.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0037313432835820895, (2, 1): 0.9925373134328358, (2, 2): 0.0037313432835820895}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0037313432835820895, (2, 1): 0.9925373134328358, (2, 2): 0.0037313432835820895}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 266.0 -> 267.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 266.0 -> 267.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 185.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=191.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9685863874345549, (1, 1): 0.010471204188481676, (1, 2): 0.020942408376963352}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9685863874345549, (1, 1): 0.010471204188481676, (1, 2): 0.020942408376963352}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 185.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=196.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01020408163265306, (0, 1): 0.9438775510204082, (0, 2): 0.04591836734693878}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.01020408163265306, (0, 1): 0.9438775510204082, (0, 2): 0.04591836734693878}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 185.0 -> 186.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 185.0 -> 186.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 267.0}
in get_filtered_urn(filter=1) --- total: total=269.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0037174721189591076, (1, 1): 0.0037174721189591076, (1, 2): 0.9925650557620818}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0037174721189591076, (1, 1): 0.0037174721189591076, (1, 2): 0.9925650557620818}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 267.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=269.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0037174721189591076, (2, 1): 0.9925650557620818, (2, 2): 0.0037174721189591076}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0037174721189591076, (2, 1): 0.9925650557620818, (2, 2): 0.0037174721189591076}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 267.0 -> 268.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 267.0 -> 268.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 186.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=192.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.96875, (1, 1): 0.010416666666666666, (1, 2): 0.020833333333333332}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.96875, (1, 1): 0.010416666666666666, (1, 2): 0.020833333333333332}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 186.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=197.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01015228426395939, (0, 1): 0.9441624365482234, (0, 2): 0.04568527918781726}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.01015228426395939, (0, 1): 0.9441624365482234, (0, 2): 0.04568527918781726}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 186.0 -> 187.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 186.0 -> 187.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 268.0}
in get_filtered_urn(filter=1) --- total: total=270.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003703703703703704, (1, 1): 0.003703703703703704, (1, 2): 0.9925925925925926}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003703703703703704, (1, 1): 0.003703703703703704, (1, 2): 0.9925925925925926}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 268.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=270.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003703703703703704, (2, 1): 0.9925925925925926, (2, 2): 0.003703703703703704}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003703703703703704, (2, 1): 0.9925925925925926, (2, 2): 0.003703703703703704}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 268.0 -> 269.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 268.0 -> 269.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 175.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=186.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04838709677419355, (2, 1): 0.9408602150537635, (2, 2): 0.010752688172043012}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04838709677419355, (2, 1): 0.9408602150537635, (2, 2): 0.010752688172043012}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 175.0}
in get_filtered_urn(filter=1) --- total: total=187.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.053475935828877004, (1, 1): 0.0106951871657754, (1, 2): 0.9358288770053476}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.053475935828877004, (1, 1): 0.0106951871657754, (1, 2): 0.9358288770053476}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 175.0 -> 176.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 175.0 -> 176.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 269.0}
in get_filtered_urn(filter=1) --- total: total=271.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0036900369003690036, (1, 1): 0.0036900369003690036, (1, 2): 0.992619926199262}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0036900369003690036, (1, 1): 0.0036900369003690036, (1, 2): 0.992619926199262}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 269.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=271.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0036900369003690036, (2, 1): 0.992619926199262, (2, 2): 0.0036900369003690036}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0036900369003690036, (2, 1): 0.992619926199262, (2, 2): 0.0036900369003690036}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 269.0 -> 270.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 269.0 -> 270.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 176.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=187.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0481283422459893, (2, 1): 0.9411764705882353, (2, 2): 0.0106951871657754}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0481283422459893, (2, 1): 0.9411764705882353, (2, 2): 0.0106951871657754}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 176.0}
in get_filtered_urn(filter=1) --- total: total=188.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05319148936170213, (1, 1): 0.010638297872340425, (1, 2): 0.9361702127659575}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05319148936170213, (1, 1): 0.010638297872340425, (1, 2): 0.9361702127659575}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 176.0 -> 177.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 176.0 -> 177.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 214.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=219.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9771689497716894, (2, 1): 0.0182648401826484, (2, 2): 0.0045662100456621}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9771689497716894, (2, 1): 0.0182648401826484, (2, 2): 0.0045662100456621}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 214.0}
in get_filtered_urn(filter=0) --- total: total=216.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004629629629629629, (0, 1): 0.004629629629629629, (0, 2): 0.9907407407407407}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004629629629629629, (0, 1): 0.004629629629629629, (0, 2): 0.9907407407407407}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 214.0 -> 215.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 214.0 -> 215.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 187.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=193.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9689119170984456, (1, 1): 0.010362694300518135, (1, 2): 0.02072538860103627}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9689119170984456, (1, 1): 0.010362694300518135, (1, 2): 0.02072538860103627}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 187.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=198.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010101010101010102, (0, 1): 0.9444444444444444, (0, 2): 0.045454545454545456}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.010101010101010102, (0, 1): 0.9444444444444444, (0, 2): 0.045454545454545456}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 187.0 -> 188.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 187.0 -> 188.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 270.0}
in get_filtered_urn(filter=1) --- total: total=272.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003676470588235294, (1, 1): 0.003676470588235294, (1, 2): 0.9926470588235294}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003676470588235294, (1, 1): 0.003676470588235294, (1, 2): 0.9926470588235294}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 270.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=272.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003676470588235294, (2, 1): 0.9926470588235294, (2, 2): 0.003676470588235294}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003676470588235294, (2, 1): 0.9926470588235294, (2, 2): 0.003676470588235294}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 270.0 -> 271.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 270.0 -> 271.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 190.0}
in get_filtered_urn(filter=0) --- total: total=202.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009900990099009901, (0, 1): 0.04950495049504951, (0, 2): 0.9405940594059405}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009900990099009901, (0, 1): 0.04950495049504951, (0, 2): 0.9405940594059405}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 190.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=196.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9693877551020408, (2, 1): 0.02040816326530612, (2, 2): 0.01020408163265306}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9693877551020408, (2, 1): 0.02040816326530612, (2, 2): 0.01020408163265306}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 190.0 -> 191.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 190.0 -> 191.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 271.0}
in get_filtered_urn(filter=1) --- total: total=273.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003663003663003663, (1, 1): 0.003663003663003663, (1, 2): 0.9926739926739927}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003663003663003663, (1, 1): 0.003663003663003663, (1, 2): 0.9926739926739927}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 271.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=273.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003663003663003663, (2, 1): 0.9926739926739927, (2, 2): 0.003663003663003663}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003663003663003663, (2, 1): 0.9926739926739927, (2, 2): 0.003663003663003663}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 271.0 -> 272.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 271.0 -> 272.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 188.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=194.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9690721649484536, (1, 1): 0.010309278350515464, (1, 2): 0.020618556701030927}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9690721649484536, (1, 1): 0.010309278350515464, (1, 2): 0.020618556701030927}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 188.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=199.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.010050251256281407, (0, 1): 0.9447236180904522, (0, 2): 0.04522613065326633}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.010050251256281407, (0, 1): 0.9447236180904522, (0, 2): 0.04522613065326633}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 188.0 -> 189.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 188.0 -> 189.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 215.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=220.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9772727272727273, (2, 1): 0.01818181818181818, (2, 2): 0.004545454545454545}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9772727272727273, (2, 1): 0.01818181818181818, (2, 2): 0.004545454545454545}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 215.0}
in get_filtered_urn(filter=0) --- total: total=217.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004608294930875576, (0, 1): 0.004608294930875576, (0, 2): 0.9907834101382489}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004608294930875576, (0, 1): 0.004608294930875576, (0, 2): 0.9907834101382489}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 215.0 -> 216.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 215.0 -> 216.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 189.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=195.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9692307692307692, (1, 1): 0.010256410256410256, (1, 2): 0.020512820512820513}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.9692307692307692, (1, 1): 0.010256410256410256, (1, 2): 0.020512820512820513}
Sender 4 got filter 1 choose option: (1, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 191.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=197.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9695431472081218, (2, 1): 0.02030456852791878, (2, 2): 0.01015228426395939}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9695431472081218, (2, 1): 0.02030456852791878, (2, 2): 0.01015228426395939}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (2, 0): 191.0 -> 191.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 236.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=238.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004201680672268907, (0, 1): 0.9915966386554622, (0, 2): 0.004201680672268907}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004201680672268907, (0, 1): 0.9915966386554622, (0, 2): 0.004201680672268907}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 236.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=241.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.979253112033195, (1, 1): 0.004149377593360996, (1, 2): 0.016597510373443983}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.979253112033195, (1, 1): 0.004149377593360996, (1, 2): 0.016597510373443983}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 236.0 -> 237.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 236.0 -> 237.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 191.0}
in get_filtered_urn(filter=0) --- total: total=203.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009852216748768473, (0, 1): 0.04926108374384237, (0, 2): 0.9408866995073891}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009852216748768473, (0, 1): 0.04926108374384237, (0, 2): 0.9408866995073891}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 191.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=197.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9695431472081218, (2, 1): 0.02030456852791878, (2, 2): 0.01015228426395939}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9695431472081218, (2, 1): 0.02030456852791878, (2, 2): 0.01015228426395939}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 191.0 -> 192.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 191.0 -> 192.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 272.0}
in get_filtered_urn(filter=1) --- total: total=274.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0036496350364963502, (1, 1): 0.0036496350364963502, (1, 2): 0.9927007299270073}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0036496350364963502, (1, 1): 0.0036496350364963502, (1, 2): 0.9927007299270073}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 272.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=274.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0036496350364963502, (2, 1): 0.9927007299270073, (2, 2): 0.0036496350364963502}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0036496350364963502, (2, 1): 0.9927007299270073, (2, 2): 0.0036496350364963502}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 272.0 -> 273.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 272.0 -> 273.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 192.0}
in get_filtered_urn(filter=0) --- total: total=204.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00980392156862745, (0, 1): 0.049019607843137254, (0, 2): 0.9411764705882353}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00980392156862745, (0, 1): 0.049019607843137254, (0, 2): 0.9411764705882353}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 192.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=198.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9696969696969697, (2, 1): 0.020202020202020204, (2, 2): 0.010101010101010102}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9696969696969697, (2, 1): 0.020202020202020204, (2, 2): 0.010101010101010102}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 192.0 -> 193.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 192.0 -> 193.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 216.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=221.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9773755656108597, (2, 1): 0.01809954751131222, (2, 2): 0.004524886877828055}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.9773755656108597, (2, 1): 0.01809954751131222, (2, 2): 0.004524886877828055}
Sender 1 got filter 2 choose option: (2, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 237.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=242.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9793388429752066, (1, 1): 0.004132231404958678, (1, 2): 0.01652892561983471}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9793388429752066, (1, 1): 0.004132231404958678, (1, 2): 0.01652892561983471}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (2, 1): 4.0 -> 4.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 0): 237.0 -> 237.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 193.0}
in get_filtered_urn(filter=0) --- total: total=205.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00975609756097561, (0, 1): 0.04878048780487805, (0, 2): 0.9414634146341463}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00975609756097561, (0, 1): 0.04878048780487805, (0, 2): 0.9414634146341463}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 193.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=199.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9698492462311558, (2, 1): 0.020100502512562814, (2, 2): 0.010050251256281407}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9698492462311558, (2, 1): 0.020100502512562814, (2, 2): 0.010050251256281407}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 193.0 -> 194.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 193.0 -> 194.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 237.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=239.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0041841004184100415, (0, 1): 0.9916317991631799, (0, 2): 0.0041841004184100415}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0041841004184100415, (0, 1): 0.9916317991631799, (0, 2): 0.0041841004184100415}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 237.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=242.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9793388429752066, (1, 1): 0.004132231404958678, (1, 2): 0.01652892561983471}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9793388429752066, (1, 1): 0.004132231404958678, (1, 2): 0.01652892561983471}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 237.0 -> 238.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 237.0 -> 238.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 189.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=195.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9692307692307692, (1, 1): 0.010256410256410256, (1, 2): 0.020512820512820513}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9692307692307692, (1, 1): 0.010256410256410256, (1, 2): 0.020512820512820513}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 189.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=200.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.01, (0, 1): 0.945, (0, 2): 0.045}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.01, (0, 1): 0.945, (0, 2): 0.045}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 189.0 -> 190.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 189.0 -> 190.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 238.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=240.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004166666666666667, (0, 1): 0.9916666666666667, (0, 2): 0.004166666666666667}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004166666666666667, (0, 1): 0.9916666666666667, (0, 2): 0.004166666666666667}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 238.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=243.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9794238683127572, (1, 1): 0.00411522633744856, (1, 2): 0.01646090534979424}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9794238683127572, (1, 1): 0.00411522633744856, (1, 2): 0.01646090534979424}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 238.0 -> 239.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 238.0 -> 239.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 177.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=188.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.047872340425531915, (2, 1): 0.9414893617021277, (2, 2): 0.010638297872340425}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.047872340425531915, (2, 1): 0.9414893617021277, (2, 2): 0.010638297872340425}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 177.0}
in get_filtered_urn(filter=1) --- total: total=189.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05291005291005291, (1, 1): 0.010582010582010581, (1, 2): 0.9365079365079365}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05291005291005291, (1, 1): 0.010582010582010581, (1, 2): 0.9365079365079365}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 177.0 -> 178.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 177.0 -> 178.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 273.0}
in get_filtered_urn(filter=1) --- total: total=275.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0036363636363636364, (1, 1): 0.0036363636363636364, (1, 2): 0.9927272727272727}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0036363636363636364, (1, 1): 0.0036363636363636364, (1, 2): 0.9927272727272727}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 273.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=275.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0036363636363636364, (2, 1): 0.9927272727272727, (2, 2): 0.0036363636363636364}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0036363636363636364, (2, 1): 0.9927272727272727, (2, 2): 0.0036363636363636364}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 273.0 -> 274.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 273.0 -> 274.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 194.0}
in get_filtered_urn(filter=0) --- total: total=206.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009708737864077669, (0, 1): 0.04854368932038835, (0, 2): 0.941747572815534}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009708737864077669, (0, 1): 0.04854368932038835, (0, 2): 0.941747572815534}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 194.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=200.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.97, (2, 1): 0.02, (2, 2): 0.01}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.97, (2, 1): 0.02, (2, 2): 0.01}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 194.0 -> 195.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 194.0 -> 195.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 274.0}
in get_filtered_urn(filter=1) --- total: total=276.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0036231884057971015, (1, 1): 0.0036231884057971015, (1, 2): 0.9927536231884058}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0036231884057971015, (1, 1): 0.0036231884057971015, (1, 2): 0.9927536231884058}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 274.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=276.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0036231884057971015, (2, 1): 0.9927536231884058, (2, 2): 0.0036231884057971015}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0036231884057971015, (2, 1): 0.9927536231884058, (2, 2): 0.0036231884057971015}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 274.0 -> 275.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 274.0 -> 275.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 190.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=196.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9693877551020408, (1, 1): 0.01020408163265306, (1, 2): 0.02040816326530612}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9693877551020408, (1, 1): 0.01020408163265306, (1, 2): 0.02040816326530612}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 190.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=201.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009950248756218905, (0, 1): 0.945273631840796, (0, 2): 0.04477611940298507}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009950248756218905, (0, 1): 0.945273631840796, (0, 2): 0.04477611940298507}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 190.0 -> 191.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 190.0 -> 191.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 216.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=221.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9773755656108597, (2, 1): 0.01809954751131222, (2, 2): 0.004524886877828055}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9773755656108597, (2, 1): 0.01809954751131222, (2, 2): 0.004524886877828055}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 216.0}
in get_filtered_urn(filter=0) --- total: total=218.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0045871559633027525, (0, 1): 0.0045871559633027525, (0, 2): 0.9908256880733946}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0045871559633027525, (0, 1): 0.0045871559633027525, (0, 2): 0.9908256880733946}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 216.0 -> 217.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 216.0 -> 217.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 195.0}
in get_filtered_urn(filter=0) --- total: total=207.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00966183574879227, (0, 1): 0.04830917874396135, (0, 2): 0.9420289855072463}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00966183574879227, (0, 1): 0.04830917874396135, (0, 2): 0.9420289855072463}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 195.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=201.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9701492537313433, (2, 1): 0.01990049751243781, (2, 2): 0.009950248756218905}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9701492537313433, (2, 1): 0.01990049751243781, (2, 2): 0.009950248756218905}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 195.0 -> 196.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 195.0 -> 196.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 275.0}
in get_filtered_urn(filter=1) --- total: total=277.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0036101083032490976, (1, 1): 0.0036101083032490976, (1, 2): 0.9927797833935018}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0036101083032490976, (1, 1): 0.0036101083032490976, (1, 2): 0.9927797833935018}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 275.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=277.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0036101083032490976, (2, 1): 0.9927797833935018, (2, 2): 0.0036101083032490976}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0036101083032490976, (2, 1): 0.9927797833935018, (2, 2): 0.0036101083032490976}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 275.0 -> 276.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 275.0 -> 276.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 178.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=189.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.047619047619047616, (2, 1): 0.9417989417989417, (2, 2): 0.010582010582010581}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.047619047619047616, (2, 1): 0.9417989417989417, (2, 2): 0.010582010582010581}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 178.0}
in get_filtered_urn(filter=1) --- total: total=190.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05263157894736842, (1, 1): 0.010526315789473684, (1, 2): 0.9368421052631579}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05263157894736842, (1, 1): 0.010526315789473684, (1, 2): 0.9368421052631579}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 178.0 -> 179.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 178.0 -> 179.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 217.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=222.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9774774774774775, (2, 1): 0.018018018018018018, (2, 2): 0.0045045045045045045}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9774774774774775, (2, 1): 0.018018018018018018, (2, 2): 0.0045045045045045045}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 217.0}
in get_filtered_urn(filter=0) --- total: total=219.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0045662100456621, (0, 1): 0.0045662100456621, (0, 2): 0.9908675799086758}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0045662100456621, (0, 1): 0.0045662100456621, (0, 2): 0.9908675799086758}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 217.0 -> 218.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 217.0 -> 218.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 179.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=190.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04736842105263158, (2, 1): 0.9421052631578948, (2, 2): 0.010526315789473684}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04736842105263158, (2, 1): 0.9421052631578948, (2, 2): 0.010526315789473684}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 179.0}
in get_filtered_urn(filter=1) --- total: total=191.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05235602094240838, (1, 1): 0.010471204188481676, (1, 2): 0.93717277486911}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05235602094240838, (1, 1): 0.010471204188481676, (1, 2): 0.93717277486911}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 179.0 -> 180.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 179.0 -> 180.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 239.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=241.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004149377593360996, (0, 1): 0.991701244813278, (0, 2): 0.004149377593360996}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004149377593360996, (0, 1): 0.991701244813278, (0, 2): 0.004149377593360996}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 239.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=244.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9795081967213115, (1, 1): 0.004098360655737705, (1, 2): 0.01639344262295082}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9795081967213115, (1, 1): 0.004098360655737705, (1, 2): 0.01639344262295082}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 239.0 -> 240.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 239.0 -> 240.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 196.0}
in get_filtered_urn(filter=0) --- total: total=208.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009615384615384616, (0, 1): 0.04807692307692308, (0, 2): 0.9423076923076923}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009615384615384616, (0, 1): 0.04807692307692308, (0, 2): 0.9423076923076923}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 196.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=202.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9702970297029703, (2, 1): 0.019801980198019802, (2, 2): 0.009900990099009901}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9702970297029703, (2, 1): 0.019801980198019802, (2, 2): 0.009900990099009901}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 196.0 -> 197.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 196.0 -> 197.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 218.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=223.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9775784753363229, (2, 1): 0.017937219730941704, (2, 2): 0.004484304932735426}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9775784753363229, (2, 1): 0.017937219730941704, (2, 2): 0.004484304932735426}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 218.0}
in get_filtered_urn(filter=0) --- total: total=220.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004545454545454545, (0, 1): 0.004545454545454545, (0, 2): 0.990909090909091}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004545454545454545, (0, 1): 0.004545454545454545, (0, 2): 0.990909090909091}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 218.0 -> 219.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 218.0 -> 219.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 197.0}
in get_filtered_urn(filter=0) --- total: total=209.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009569377990430622, (0, 1): 0.04784688995215311, (0, 2): 0.9425837320574163}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009569377990430622, (0, 1): 0.04784688995215311, (0, 2): 0.9425837320574163}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 197.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=203.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9704433497536946, (2, 1): 0.019704433497536946, (2, 2): 0.009852216748768473}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9704433497536946, (2, 1): 0.019704433497536946, (2, 2): 0.009852216748768473}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 197.0 -> 198.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 197.0 -> 198.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 219.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=224.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9776785714285714, (2, 1): 0.017857142857142856, (2, 2): 0.004464285714285714}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9776785714285714, (2, 1): 0.017857142857142856, (2, 2): 0.004464285714285714}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 219.0}
in get_filtered_urn(filter=0) --- total: total=221.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004524886877828055, (0, 1): 0.004524886877828055, (0, 2): 0.9909502262443439}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004524886877828055, (0, 1): 0.004524886877828055, (0, 2): 0.9909502262443439}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 219.0 -> 220.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 219.0 -> 220.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 198.0}
in get_filtered_urn(filter=0) --- total: total=210.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009523809523809525, (0, 1): 0.047619047619047616, (0, 2): 0.9428571428571428}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009523809523809525, (0, 1): 0.047619047619047616, (0, 2): 0.9428571428571428}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 198.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=204.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9705882352941176, (2, 1): 0.0196078431372549, (2, 2): 0.00980392156862745}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9705882352941176, (2, 1): 0.0196078431372549, (2, 2): 0.00980392156862745}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 198.0 -> 199.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 198.0 -> 199.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 220.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=225.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9777777777777777, (2, 1): 0.017777777777777778, (2, 2): 0.0044444444444444444}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9777777777777777, (2, 1): 0.017777777777777778, (2, 2): 0.0044444444444444444}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 220.0}
in get_filtered_urn(filter=0) --- total: total=222.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0045045045045045045, (0, 1): 0.0045045045045045045, (0, 2): 0.990990990990991}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0045045045045045045, (0, 1): 0.0045045045045045045, (0, 2): 0.990990990990991}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 220.0 -> 221.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 220.0 -> 221.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 191.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=197.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9695431472081218, (1, 1): 0.01015228426395939, (1, 2): 0.02030456852791878}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9695431472081218, (1, 1): 0.01015228426395939, (1, 2): 0.02030456852791878}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 191.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=202.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009900990099009901, (0, 1): 0.9455445544554455, (0, 2): 0.04455445544554455}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009900990099009901, (0, 1): 0.9455445544554455, (0, 2): 0.04455445544554455}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 191.0 -> 192.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 191.0 -> 192.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 221.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=226.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9778761061946902, (2, 1): 0.017699115044247787, (2, 2): 0.004424778761061947}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9778761061946902, (2, 1): 0.017699115044247787, (2, 2): 0.004424778761061947}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 221.0}
in get_filtered_urn(filter=0) --- total: total=223.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004484304932735426, (0, 1): 0.004484304932735426, (0, 2): 0.9910313901345291}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004484304932735426, (0, 1): 0.004484304932735426, (0, 2): 0.9910313901345291}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 221.0 -> 222.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 221.0 -> 222.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 192.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=198.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9696969696969697, (1, 1): 0.010101010101010102, (1, 2): 0.020202020202020204}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9696969696969697, (1, 1): 0.010101010101010102, (1, 2): 0.020202020202020204}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 192.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=203.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009852216748768473, (0, 1): 0.9458128078817734, (0, 2): 0.04433497536945813}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009852216748768473, (0, 1): 0.9458128078817734, (0, 2): 0.04433497536945813}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 192.0 -> 193.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 192.0 -> 193.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 276.0}
in get_filtered_urn(filter=1) --- total: total=278.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0035971223021582736, (1, 1): 0.0035971223021582736, (1, 2): 0.9928057553956835}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0035971223021582736, (1, 1): 0.0035971223021582736, (1, 2): 0.9928057553956835}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 276.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=278.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0035971223021582736, (2, 1): 0.9928057553956835, (2, 2): 0.0035971223021582736}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0035971223021582736, (2, 1): 0.9928057553956835, (2, 2): 0.0035971223021582736}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 276.0 -> 277.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 276.0 -> 277.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 199.0}
in get_filtered_urn(filter=0) --- total: total=211.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009478672985781991, (0, 1): 0.04739336492890995, (0, 2): 0.943127962085308}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009478672985781991, (0, 1): 0.04739336492890995, (0, 2): 0.943127962085308}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 199.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=205.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9707317073170731, (2, 1): 0.01951219512195122, (2, 2): 0.00975609756097561}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9707317073170731, (2, 1): 0.01951219512195122, (2, 2): 0.00975609756097561}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 199.0 -> 200.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 199.0 -> 200.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 240.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=242.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004132231404958678, (0, 1): 0.9917355371900827, (0, 2): 0.004132231404958678}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004132231404958678, (0, 1): 0.9917355371900827, (0, 2): 0.004132231404958678}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 240.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=245.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9795918367346939, (1, 1): 0.004081632653061225, (1, 2): 0.0163265306122449}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9795918367346939, (1, 1): 0.004081632653061225, (1, 2): 0.0163265306122449}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 240.0 -> 241.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 240.0 -> 241.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 200.0}
in get_filtered_urn(filter=0) --- total: total=212.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009433962264150943, (0, 1): 0.04716981132075472, (0, 2): 0.9433962264150944}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009433962264150943, (0, 1): 0.04716981132075472, (0, 2): 0.9433962264150944}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 200.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=206.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.970873786407767, (2, 1): 0.019417475728155338, (2, 2): 0.009708737864077669}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.970873786407767, (2, 1): 0.019417475728155338, (2, 2): 0.009708737864077669}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 200.0 -> 201.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 200.0 -> 201.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 277.0}
in get_filtered_urn(filter=1) --- total: total=279.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0035842293906810036, (1, 1): 0.0035842293906810036, (1, 2): 0.992831541218638}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0035842293906810036, (1, 1): 0.0035842293906810036, (1, 2): 0.992831541218638}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 277.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=279.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0035842293906810036, (2, 1): 0.992831541218638, (2, 2): 0.0035842293906810036}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0035842293906810036, (2, 1): 0.992831541218638, (2, 2): 0.0035842293906810036}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 277.0 -> 278.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 277.0 -> 278.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 193.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=199.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9698492462311558, (1, 1): 0.010050251256281407, (1, 2): 0.020100502512562814}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9698492462311558, (1, 1): 0.010050251256281407, (1, 2): 0.020100502512562814}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 193.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=204.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00980392156862745, (0, 1): 0.946078431372549, (0, 2): 0.04411764705882353}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00980392156862745, (0, 1): 0.946078431372549, (0, 2): 0.04411764705882353}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 193.0 -> 194.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 193.0 -> 194.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 278.0}
in get_filtered_urn(filter=1) --- total: total=280.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0035714285714285713, (1, 1): 0.0035714285714285713, (1, 2): 0.9928571428571429}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0035714285714285713, (1, 1): 0.0035714285714285713, (1, 2): 0.9928571428571429}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 278.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=280.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0035714285714285713, (2, 1): 0.9928571428571429, (2, 2): 0.0035714285714285713}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0035714285714285713, (2, 1): 0.9928571428571429, (2, 2): 0.0035714285714285713}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 278.0 -> 279.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 278.0 -> 279.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 194.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=200.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.97, (1, 1): 0.01, (1, 2): 0.02}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.97, (1, 1): 0.01, (1, 2): 0.02}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 194.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=205.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00975609756097561, (0, 1): 0.9463414634146341, (0, 2): 0.04390243902439024}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00975609756097561, (0, 1): 0.9463414634146341, (0, 2): 0.04390243902439024}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 194.0 -> 195.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 194.0 -> 195.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 222.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=227.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9779735682819384, (2, 1): 0.01762114537444934, (2, 2): 0.004405286343612335}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9779735682819384, (2, 1): 0.01762114537444934, (2, 2): 0.004405286343612335}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 222.0}
in get_filtered_urn(filter=0) --- total: total=224.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004464285714285714, (0, 1): 0.004464285714285714, (0, 2): 0.9910714285714286}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004464285714285714, (0, 1): 0.004464285714285714, (0, 2): 0.9910714285714286}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 222.0 -> 223.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 222.0 -> 223.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 180.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=191.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04712041884816754, (2, 1): 0.9424083769633508, (2, 2): 0.010471204188481676}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04712041884816754, (2, 1): 0.9424083769633508, (2, 2): 0.010471204188481676}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 180.0}
in get_filtered_urn(filter=1) --- total: total=192.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.052083333333333336, (1, 1): 0.010416666666666666, (1, 2): 0.9375}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.052083333333333336, (1, 1): 0.010416666666666666, (1, 2): 0.9375}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 180.0 -> 181.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 180.0 -> 181.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 223.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=228.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9780701754385965, (2, 1): 0.017543859649122806, (2, 2): 0.0043859649122807015}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9780701754385965, (2, 1): 0.017543859649122806, (2, 2): 0.0043859649122807015}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 223.0}
in get_filtered_urn(filter=0) --- total: total=225.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0044444444444444444, (0, 1): 0.0044444444444444444, (0, 2): 0.9911111111111112}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0044444444444444444, (0, 1): 0.0044444444444444444, (0, 2): 0.9911111111111112}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 223.0 -> 224.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 223.0 -> 224.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 195.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=201.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9701492537313433, (1, 1): 0.009950248756218905, (1, 2): 0.01990049751243781}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9701492537313433, (1, 1): 0.009950248756218905, (1, 2): 0.01990049751243781}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 195.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=206.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009708737864077669, (0, 1): 0.9466019417475728, (0, 2): 0.043689320388349516}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009708737864077669, (0, 1): 0.9466019417475728, (0, 2): 0.043689320388349516}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 195.0 -> 196.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 195.0 -> 196.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 279.0}
in get_filtered_urn(filter=1) --- total: total=281.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0035587188612099642, (1, 1): 0.0035587188612099642, (1, 2): 0.9928825622775801}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0035587188612099642, (1, 1): 0.0035587188612099642, (1, 2): 0.9928825622775801}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 279.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=281.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0035587188612099642, (2, 1): 0.9928825622775801, (2, 2): 0.0035587188612099642}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0035587188612099642, (2, 1): 0.9928825622775801, (2, 2): 0.0035587188612099642}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 279.0 -> 280.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 279.0 -> 280.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 201.0}
in get_filtered_urn(filter=0) --- total: total=213.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009389671361502348, (0, 1): 0.046948356807511735, (0, 2): 0.9436619718309859}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009389671361502348, (0, 1): 0.046948356807511735, (0, 2): 0.9436619718309859}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 201.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=207.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9710144927536232, (2, 1): 0.01932367149758454, (2, 2): 0.00966183574879227}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9710144927536232, (2, 1): 0.01932367149758454, (2, 2): 0.00966183574879227}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 201.0 -> 202.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 201.0 -> 202.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 280.0}
in get_filtered_urn(filter=1) --- total: total=282.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0035460992907801418, (1, 1): 0.0035460992907801418, (1, 2): 0.9929078014184397}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0035460992907801418, (1, 1): 0.0035460992907801418, (1, 2): 0.9929078014184397}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 280.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=282.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0035460992907801418, (2, 1): 0.9929078014184397, (2, 2): 0.0035460992907801418}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0035460992907801418, (2, 1): 0.9929078014184397, (2, 2): 0.0035460992907801418}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 280.0 -> 281.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 280.0 -> 281.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 202.0}
in get_filtered_urn(filter=0) --- total: total=214.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009345794392523364, (0, 1): 0.04672897196261682, (0, 2): 0.9439252336448598}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009345794392523364, (0, 1): 0.04672897196261682, (0, 2): 0.9439252336448598}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 202.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=208.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9711538461538461, (2, 1): 0.019230769230769232, (2, 2): 0.009615384615384616}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9711538461538461, (2, 1): 0.019230769230769232, (2, 2): 0.009615384615384616}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 202.0 -> 203.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 202.0 -> 203.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 281.0}
in get_filtered_urn(filter=1) --- total: total=283.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0035335689045936395, (1, 1): 0.0035335689045936395, (1, 2): 0.9929328621908127}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0035335689045936395, (1, 1): 0.0035335689045936395, (1, 2): 0.9929328621908127}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 281.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=283.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0035335689045936395, (2, 1): 0.9929328621908127, (2, 2): 0.0035335689045936395}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0035335689045936395, (2, 1): 0.9929328621908127, (2, 2): 0.0035335689045936395}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 281.0 -> 282.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 281.0 -> 282.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 203.0}
in get_filtered_urn(filter=0) --- total: total=215.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009302325581395349, (0, 1): 0.046511627906976744, (0, 2): 0.9441860465116279}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009302325581395349, (0, 1): 0.046511627906976744, (0, 2): 0.9441860465116279}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 203.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=209.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9712918660287081, (2, 1): 0.019138755980861243, (2, 2): 0.009569377990430622}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9712918660287081, (2, 1): 0.019138755980861243, (2, 2): 0.009569377990430622}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 203.0 -> 204.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 203.0 -> 204.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 282.0}
in get_filtered_urn(filter=1) --- total: total=284.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0035211267605633804, (1, 1): 0.0035211267605633804, (1, 2): 0.9929577464788732}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0035211267605633804, (1, 1): 0.0035211267605633804, (1, 2): 0.9929577464788732}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 282.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=284.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0035211267605633804, (2, 1): 0.9929577464788732, (2, 2): 0.0035211267605633804}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0035211267605633804, (2, 1): 0.9929577464788732, (2, 2): 0.0035211267605633804}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 282.0 -> 283.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 282.0 -> 283.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 181.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=192.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.046875, (2, 1): 0.9427083333333334, (2, 2): 0.010416666666666666}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.046875, (2, 1): 0.9427083333333334, (2, 2): 0.010416666666666666}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 181.0}
in get_filtered_urn(filter=1) --- total: total=193.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05181347150259067, (1, 1): 0.010362694300518135, (1, 2): 0.9378238341968912}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05181347150259067, (1, 1): 0.010362694300518135, (1, 2): 0.9378238341968912}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 181.0 -> 182.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 181.0 -> 182.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 283.0}
in get_filtered_urn(filter=1) --- total: total=285.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0035087719298245615, (1, 1): 0.0035087719298245615, (1, 2): 0.9929824561403509}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0035087719298245615, (1, 1): 0.0035087719298245615, (1, 2): 0.9929824561403509}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 283.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=285.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0035087719298245615, (2, 1): 0.9929824561403509, (2, 2): 0.0035087719298245615}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0035087719298245615, (2, 1): 0.9929824561403509, (2, 2): 0.0035087719298245615}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 283.0 -> 284.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 283.0 -> 284.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 196.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=202.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9702970297029703, (1, 1): 0.009900990099009901, (1, 2): 0.019801980198019802}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9702970297029703, (1, 1): 0.009900990099009901, (1, 2): 0.019801980198019802}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 196.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=207.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00966183574879227, (0, 1): 0.9468599033816425, (0, 2): 0.043478260869565216}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00966183574879227, (0, 1): 0.9468599033816425, (0, 2): 0.043478260869565216}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 196.0 -> 197.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 196.0 -> 197.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 284.0}
in get_filtered_urn(filter=1) --- total: total=286.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0034965034965034965, (1, 1): 0.0034965034965034965, (1, 2): 0.993006993006993}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0034965034965034965, (1, 1): 0.0034965034965034965, (1, 2): 0.993006993006993}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 284.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=286.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0034965034965034965, (2, 1): 0.993006993006993, (2, 2): 0.0034965034965034965}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0034965034965034965, (2, 1): 0.993006993006993, (2, 2): 0.0034965034965034965}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 284.0 -> 285.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 284.0 -> 285.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 197.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=203.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9704433497536946, (1, 1): 0.009852216748768473, (1, 2): 0.019704433497536946}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9704433497536946, (1, 1): 0.009852216748768473, (1, 2): 0.019704433497536946}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 197.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=208.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009615384615384616, (0, 1): 0.9471153846153846, (0, 2): 0.04326923076923077}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009615384615384616, (0, 1): 0.9471153846153846, (0, 2): 0.04326923076923077}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 197.0 -> 198.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 197.0 -> 198.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 285.0}
in get_filtered_urn(filter=1) --- total: total=287.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003484320557491289, (1, 1): 0.003484320557491289, (1, 2): 0.9930313588850174}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003484320557491289, (1, 1): 0.003484320557491289, (1, 2): 0.9930313588850174}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 285.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=287.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003484320557491289, (2, 1): 0.9930313588850174, (2, 2): 0.003484320557491289}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003484320557491289, (2, 1): 0.9930313588850174, (2, 2): 0.003484320557491289}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 285.0 -> 286.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 285.0 -> 286.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 182.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=193.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.046632124352331605, (2, 1): 0.9430051813471503, (2, 2): 0.010362694300518135}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.046632124352331605, (2, 1): 0.9430051813471503, (2, 2): 0.010362694300518135}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 182.0}
in get_filtered_urn(filter=1) --- total: total=194.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05154639175257732, (1, 1): 0.010309278350515464, (1, 2): 0.9381443298969072}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05154639175257732, (1, 1): 0.010309278350515464, (1, 2): 0.9381443298969072}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 182.0 -> 183.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 182.0 -> 183.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 241.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=243.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00411522633744856, (0, 1): 0.9917695473251029, (0, 2): 0.00411522633744856}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00411522633744856, (0, 1): 0.9917695473251029, (0, 2): 0.00411522633744856}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 241.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=246.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9796747967479674, (1, 1): 0.0040650406504065045, (1, 2): 0.016260162601626018}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9796747967479674, (1, 1): 0.0040650406504065045, (1, 2): 0.016260162601626018}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 241.0 -> 242.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 241.0 -> 242.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 183.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=194.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04639175257731959, (2, 1): 0.9432989690721649, (2, 2): 0.010309278350515464}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04639175257731959, (2, 1): 0.9432989690721649, (2, 2): 0.010309278350515464}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 183.0}
in get_filtered_urn(filter=1) --- total: total=195.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05128205128205128, (1, 1): 0.010256410256410256, (1, 2): 0.9384615384615385}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05128205128205128, (1, 1): 0.010256410256410256, (1, 2): 0.9384615384615385}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 183.0 -> 184.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 183.0 -> 184.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 286.0}
in get_filtered_urn(filter=1) --- total: total=288.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003472222222222222, (1, 1): 0.003472222222222222, (1, 2): 0.9930555555555556}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003472222222222222, (1, 1): 0.003472222222222222, (1, 2): 0.9930555555555556}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 286.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=288.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003472222222222222, (2, 1): 0.9930555555555556, (2, 2): 0.003472222222222222}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003472222222222222, (2, 1): 0.9930555555555556, (2, 2): 0.003472222222222222}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 286.0 -> 287.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 286.0 -> 287.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 198.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=204.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9705882352941176, (1, 1): 0.00980392156862745, (1, 2): 0.0196078431372549}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9705882352941176, (1, 1): 0.00980392156862745, (1, 2): 0.0196078431372549}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 198.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=209.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009569377990430622, (0, 1): 0.9473684210526315, (0, 2): 0.0430622009569378}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009569377990430622, (0, 1): 0.9473684210526315, (0, 2): 0.0430622009569378}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 198.0 -> 199.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 198.0 -> 199.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 287.0}
in get_filtered_urn(filter=1) --- total: total=289.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0034602076124567475, (1, 1): 0.0034602076124567475, (1, 2): 0.9930795847750865}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0034602076124567475, (1, 1): 0.0034602076124567475, (1, 2): 0.9930795847750865}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 287.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=289.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0034602076124567475, (2, 1): 0.9930795847750865, (2, 2): 0.0034602076124567475}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0034602076124567475, (2, 1): 0.9930795847750865, (2, 2): 0.0034602076124567475}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 287.0 -> 288.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 287.0 -> 288.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 204.0}
in get_filtered_urn(filter=0) --- total: total=216.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009259259259259259, (0, 1): 0.046296296296296294, (0, 2): 0.9444444444444444}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009259259259259259, (0, 1): 0.046296296296296294, (0, 2): 0.9444444444444444}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 204.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=210.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9714285714285714, (2, 1): 0.01904761904761905, (2, 2): 0.009523809523809525}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9714285714285714, (2, 1): 0.01904761904761905, (2, 2): 0.009523809523809525}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 204.0 -> 205.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 204.0 -> 205.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 242.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=244.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004098360655737705, (0, 1): 0.9918032786885246, (0, 2): 0.004098360655737705}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004098360655737705, (0, 1): 0.9918032786885246, (0, 2): 0.004098360655737705}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 242.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=247.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.979757085020243, (1, 1): 0.004048582995951417, (1, 2): 0.016194331983805668}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.979757085020243, (1, 1): 0.004048582995951417, (1, 2): 0.016194331983805668}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 242.0 -> 243.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 242.0 -> 243.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 199.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=205.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9707317073170731, (1, 1): 0.00975609756097561, (1, 2): 0.01951219512195122}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9707317073170731, (1, 1): 0.00975609756097561, (1, 2): 0.01951219512195122}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 199.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=210.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009523809523809525, (0, 1): 0.9476190476190476, (0, 2): 0.04285714285714286}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009523809523809525, (0, 1): 0.9476190476190476, (0, 2): 0.04285714285714286}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 199.0 -> 200.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 199.0 -> 200.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 243.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=245.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004081632653061225, (0, 1): 0.9918367346938776, (0, 2): 0.004081632653061225}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004081632653061225, (0, 1): 0.9918367346938776, (0, 2): 0.004081632653061225}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 243.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=248.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9798387096774194, (1, 1): 0.004032258064516129, (1, 2): 0.016129032258064516}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9798387096774194, (1, 1): 0.004032258064516129, (1, 2): 0.016129032258064516}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 243.0 -> 244.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 243.0 -> 244.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 200.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=206.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.970873786407767, (1, 1): 0.009708737864077669, (1, 2): 0.019417475728155338}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.970873786407767, (1, 1): 0.009708737864077669, (1, 2): 0.019417475728155338}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 200.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=211.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009478672985781991, (0, 1): 0.9478672985781991, (0, 2): 0.04265402843601896}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009478672985781991, (0, 1): 0.9478672985781991, (0, 2): 0.04265402843601896}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 200.0 -> 201.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 200.0 -> 201.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 224.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=229.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9781659388646288, (2, 1): 0.017467248908296942, (2, 2): 0.004366812227074236}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9781659388646288, (2, 1): 0.017467248908296942, (2, 2): 0.004366812227074236}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 224.0}
in get_filtered_urn(filter=0) --- total: total=226.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004424778761061947, (0, 1): 0.004424778761061947, (0, 2): 0.9911504424778761}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004424778761061947, (0, 1): 0.004424778761061947, (0, 2): 0.9911504424778761}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 224.0 -> 225.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 224.0 -> 225.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 201.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=207.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9710144927536232, (1, 1): 0.00966183574879227, (1, 2): 0.01932367149758454}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9710144927536232, (1, 1): 0.00966183574879227, (1, 2): 0.01932367149758454}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 201.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=212.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009433962264150943, (0, 1): 0.9481132075471698, (0, 2): 0.04245283018867924}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009433962264150943, (0, 1): 0.9481132075471698, (0, 2): 0.04245283018867924}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 201.0 -> 202.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 201.0 -> 202.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 244.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=246.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0040650406504065045, (0, 1): 0.991869918699187, (0, 2): 0.0040650406504065045}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0040650406504065045, (0, 1): 0.991869918699187, (0, 2): 0.0040650406504065045}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 244.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=249.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9799196787148594, (1, 1): 0.004016064257028112, (1, 2): 0.01606425702811245}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9799196787148594, (1, 1): 0.004016064257028112, (1, 2): 0.01606425702811245}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 244.0 -> 245.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 244.0 -> 245.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 205.0}
in get_filtered_urn(filter=0) --- total: total=217.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009216589861751152, (0, 1): 0.04608294930875576, (0, 2): 0.9447004608294931}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009216589861751152, (0, 1): 0.04608294930875576, (0, 2): 0.9447004608294931}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 205.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=211.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9715639810426541, (2, 1): 0.018957345971563982, (2, 2): 0.009478672985781991}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9715639810426541, (2, 1): 0.018957345971563982, (2, 2): 0.009478672985781991}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 205.0 -> 206.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 205.0 -> 206.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 288.0}
in get_filtered_urn(filter=1) --- total: total=290.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0034482758620689655, (1, 1): 0.0034482758620689655, (1, 2): 0.993103448275862}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0034482758620689655, (1, 1): 0.0034482758620689655, (1, 2): 0.993103448275862}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 288.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=290.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0034482758620689655, (2, 1): 0.993103448275862, (2, 2): 0.0034482758620689655}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0034482758620689655, (2, 1): 0.993103448275862, (2, 2): 0.0034482758620689655}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 288.0 -> 289.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 288.0 -> 289.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 202.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=208.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9711538461538461, (1, 1): 0.009615384615384616, (1, 2): 0.019230769230769232}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9711538461538461, (1, 1): 0.009615384615384616, (1, 2): 0.019230769230769232}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 202.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=213.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009389671361502348, (0, 1): 0.9483568075117371, (0, 2): 0.04225352112676056}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009389671361502348, (0, 1): 0.9483568075117371, (0, 2): 0.04225352112676056}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 202.0 -> 203.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 202.0 -> 203.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 225.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=230.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9782608695652174, (2, 1): 0.017391304347826087, (2, 2): 0.004347826086956522}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9782608695652174, (2, 1): 0.017391304347826087, (2, 2): 0.004347826086956522}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 225.0}
in get_filtered_urn(filter=0) --- total: total=227.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004405286343612335, (0, 1): 0.004405286343612335, (0, 2): 0.9911894273127754}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004405286343612335, (0, 1): 0.004405286343612335, (0, 2): 0.9911894273127754}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 225.0 -> 226.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 225.0 -> 226.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 206.0}
in get_filtered_urn(filter=0) --- total: total=218.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009174311926605505, (0, 1): 0.045871559633027525, (0, 2): 0.944954128440367}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009174311926605505, (0, 1): 0.045871559633027525, (0, 2): 0.944954128440367}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 206.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=212.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9716981132075472, (2, 1): 0.018867924528301886, (2, 2): 0.009433962264150943}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9716981132075472, (2, 1): 0.018867924528301886, (2, 2): 0.009433962264150943}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 206.0 -> 207.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 206.0 -> 207.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 226.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=231.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9783549783549783, (2, 1): 0.017316017316017316, (2, 2): 0.004329004329004329}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9783549783549783, (2, 1): 0.017316017316017316, (2, 2): 0.004329004329004329}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 226.0}
in get_filtered_urn(filter=0) --- total: total=228.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0043859649122807015, (0, 1): 0.0043859649122807015, (0, 2): 0.9912280701754386}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0043859649122807015, (0, 1): 0.0043859649122807015, (0, 2): 0.9912280701754386}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 226.0 -> 227.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 226.0 -> 227.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 207.0}
in get_filtered_urn(filter=0) --- total: total=219.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0091324200913242, (0, 1): 0.045662100456621, (0, 2): 0.9452054794520548}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0091324200913242, (0, 1): 0.045662100456621, (0, 2): 0.9452054794520548}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 207.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=213.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.971830985915493, (2, 1): 0.018779342723004695, (2, 2): 0.009389671361502348}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.971830985915493, (2, 1): 0.018779342723004695, (2, 2): 0.009389671361502348}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 207.0 -> 208.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 207.0 -> 208.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 245.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=247.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004048582995951417, (0, 1): 0.9919028340080972, (0, 2): 0.004048582995951417}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004048582995951417, (0, 1): 0.9919028340080972, (0, 2): 0.004048582995951417}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 245.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=250.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.98, (1, 1): 0.004, (1, 2): 0.016}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.98, (1, 1): 0.004, (1, 2): 0.016}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 245.0 -> 246.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 245.0 -> 246.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 203.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=209.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9712918660287081, (1, 1): 0.009569377990430622, (1, 2): 0.019138755980861243}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9712918660287081, (1, 1): 0.009569377990430622, (1, 2): 0.019138755980861243}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 203.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=214.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009345794392523364, (0, 1): 0.9485981308411215, (0, 2): 0.04205607476635514}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009345794392523364, (0, 1): 0.9485981308411215, (0, 2): 0.04205607476635514}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 203.0 -> 204.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 203.0 -> 204.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 246.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=248.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004032258064516129, (0, 1): 0.9919354838709677, (0, 2): 0.004032258064516129}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004032258064516129, (0, 1): 0.9919354838709677, (0, 2): 0.004032258064516129}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 246.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=251.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9800796812749004, (1, 1): 0.00398406374501992, (1, 2): 0.01593625498007968}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9800796812749004, (1, 1): 0.00398406374501992, (1, 2): 0.01593625498007968}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 246.0 -> 247.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 246.0 -> 247.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 208.0}
in get_filtered_urn(filter=0) --- total: total=220.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00909090909090909, (0, 1): 0.045454545454545456, (0, 2): 0.9454545454545454}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00909090909090909, (0, 1): 0.045454545454545456, (0, 2): 0.9454545454545454}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 208.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=214.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9719626168224299, (2, 1): 0.018691588785046728, (2, 2): 0.009345794392523364}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9719626168224299, (2, 1): 0.018691588785046728, (2, 2): 0.009345794392523364}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 208.0 -> 209.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 208.0 -> 209.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 247.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=249.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004016064257028112, (0, 1): 0.9919678714859438, (0, 2): 0.004016064257028112}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004016064257028112, (0, 1): 0.9919678714859438, (0, 2): 0.004016064257028112}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 247.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=252.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9801587301587301, (1, 1): 0.003968253968253968, (1, 2): 0.015873015873015872}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9801587301587301, (1, 1): 0.003968253968253968, (1, 2): 0.015873015873015872}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 247.0 -> 248.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 247.0 -> 248.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 204.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=210.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9714285714285714, (1, 1): 0.009523809523809525, (1, 2): 0.01904761904761905}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9714285714285714, (1, 1): 0.009523809523809525, (1, 2): 0.01904761904761905}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 204.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=215.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009302325581395349, (0, 1): 0.9488372093023256, (0, 2): 0.04186046511627907}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009302325581395349, (0, 1): 0.9488372093023256, (0, 2): 0.04186046511627907}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 204.0 -> 205.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 204.0 -> 205.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 248.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=250.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004, (0, 1): 0.992, (0, 2): 0.004}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.004, (0, 1): 0.992, (0, 2): 0.004}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 248.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=253.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9802371541501976, (1, 1): 0.003952569169960474, (1, 2): 0.015810276679841896}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9802371541501976, (1, 1): 0.003952569169960474, (1, 2): 0.015810276679841896}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 248.0 -> 249.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 248.0 -> 249.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 184.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=195.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.046153846153846156, (2, 1): 0.9435897435897436, (2, 2): 0.010256410256410256}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.046153846153846156, (2, 1): 0.9435897435897436, (2, 2): 0.010256410256410256}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 184.0}
in get_filtered_urn(filter=1) --- total: total=196.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05102040816326531, (1, 1): 0.01020408163265306, (1, 2): 0.9387755102040817}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05102040816326531, (1, 1): 0.01020408163265306, (1, 2): 0.9387755102040817}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 184.0 -> 185.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 184.0 -> 185.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 289.0}
in get_filtered_urn(filter=1) --- total: total=291.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003436426116838488, (1, 1): 0.003436426116838488, (1, 2): 0.993127147766323}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003436426116838488, (1, 1): 0.003436426116838488, (1, 2): 0.993127147766323}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 289.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=291.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003436426116838488, (2, 1): 0.993127147766323, (2, 2): 0.003436426116838488}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003436426116838488, (2, 1): 0.993127147766323, (2, 2): 0.003436426116838488}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 289.0 -> 290.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 289.0 -> 290.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 185.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=196.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04591836734693878, (2, 1): 0.9438775510204082, (2, 2): 0.01020408163265306}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04591836734693878, (2, 1): 0.9438775510204082, (2, 2): 0.01020408163265306}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 185.0}
in get_filtered_urn(filter=1) --- total: total=197.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.050761421319796954, (1, 1): 0.01015228426395939, (1, 2): 0.9390862944162437}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.050761421319796954, (1, 1): 0.01015228426395939, (1, 2): 0.9390862944162437}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 185.0 -> 186.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 185.0 -> 186.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 249.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=251.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00398406374501992, (0, 1): 0.9920318725099602, (0, 2): 0.00398406374501992}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00398406374501992, (0, 1): 0.9920318725099602, (0, 2): 0.00398406374501992}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 249.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=254.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9803149606299213, (1, 1): 0.003937007874015748, (1, 2): 0.015748031496062992}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9803149606299213, (1, 1): 0.003937007874015748, (1, 2): 0.015748031496062992}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 249.0 -> 250.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 249.0 -> 250.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 205.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=211.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9715639810426541, (1, 1): 0.009478672985781991, (1, 2): 0.018957345971563982}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9715639810426541, (1, 1): 0.009478672985781991, (1, 2): 0.018957345971563982}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 205.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=216.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009259259259259259, (0, 1): 0.9490740740740741, (0, 2): 0.041666666666666664}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009259259259259259, (0, 1): 0.9490740740740741, (0, 2): 0.041666666666666664}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 205.0 -> 206.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 205.0 -> 206.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 227.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=232.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.978448275862069, (2, 1): 0.017241379310344827, (2, 2): 0.004310344827586207}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.978448275862069, (2, 1): 0.017241379310344827, (2, 2): 0.004310344827586207}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 227.0}
in get_filtered_urn(filter=0) --- total: total=229.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004366812227074236, (0, 1): 0.004366812227074236, (0, 2): 0.9912663755458515}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004366812227074236, (0, 1): 0.004366812227074236, (0, 2): 0.9912663755458515}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 227.0 -> 228.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 227.0 -> 228.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 206.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=212.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9716981132075472, (1, 1): 0.009433962264150943, (1, 2): 0.018867924528301886}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9716981132075472, (1, 1): 0.009433962264150943, (1, 2): 0.018867924528301886}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 206.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=217.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009216589861751152, (0, 1): 0.9493087557603687, (0, 2): 0.041474654377880185}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.009216589861751152, (0, 1): 0.9493087557603687, (0, 2): 0.041474654377880185}
in decode_message(signal=0) Receiver 5 got option: (0, 0) and decoded action: 0
Receiver 5 received signals: [0] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 0): 206.0 -> 206.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 0): 2.0 -> 2.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 290.0}
in get_filtered_urn(filter=1) --- total: total=292.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003424657534246575, (1, 1): 0.003424657534246575, (1, 2): 0.9931506849315068}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003424657534246575, (1, 1): 0.003424657534246575, (1, 2): 0.9931506849315068}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 290.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=292.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003424657534246575, (2, 1): 0.9931506849315068, (2, 2): 0.003424657534246575}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003424657534246575, (2, 1): 0.9931506849315068, (2, 2): 0.003424657534246575}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 290.0 -> 291.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 290.0 -> 291.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 206.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=212.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9716981132075472, (1, 1): 0.009433962264150943, (1, 2): 0.018867924528301886}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9716981132075472, (1, 1): 0.009433962264150943, (1, 2): 0.018867924528301886}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 206.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=217.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009216589861751152, (0, 1): 0.9493087557603687, (0, 2): 0.041474654377880185}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009216589861751152, (0, 1): 0.9493087557603687, (0, 2): 0.041474654377880185}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 206.0 -> 207.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 206.0 -> 207.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 228.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=233.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9785407725321889, (2, 1): 0.017167381974248927, (2, 2): 0.004291845493562232}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9785407725321889, (2, 1): 0.017167381974248927, (2, 2): 0.004291845493562232}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 228.0}
in get_filtered_urn(filter=0) --- total: total=230.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004347826086956522, (0, 1): 0.004347826086956522, (0, 2): 0.991304347826087}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004347826086956522, (0, 1): 0.004347826086956522, (0, 2): 0.991304347826087}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 228.0 -> 229.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 228.0 -> 229.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 186.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=197.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04568527918781726, (2, 1): 0.9441624365482234, (2, 2): 0.01015228426395939}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04568527918781726, (2, 1): 0.9441624365482234, (2, 2): 0.01015228426395939}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 186.0}
in get_filtered_urn(filter=1) --- total: total=198.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.050505050505050504, (1, 1): 0.010101010101010102, (1, 2): 0.9393939393939394}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.050505050505050504, (1, 1): 0.010101010101010102, (1, 2): 0.9393939393939394}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 186.0 -> 187.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 186.0 -> 187.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 229.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=234.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9786324786324786, (2, 1): 0.017094017094017096, (2, 2): 0.004273504273504274}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9786324786324786, (2, 1): 0.017094017094017096, (2, 2): 0.004273504273504274}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 229.0}
in get_filtered_urn(filter=0) --- total: total=231.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004329004329004329, (0, 1): 0.004329004329004329, (0, 2): 0.9913419913419913}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004329004329004329, (0, 1): 0.004329004329004329, (0, 2): 0.9913419913419913}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 229.0 -> 230.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 229.0 -> 230.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 209.0}
in get_filtered_urn(filter=0) --- total: total=221.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00904977375565611, (0, 1): 0.04524886877828054, (0, 2): 0.9457013574660633}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00904977375565611, (0, 1): 0.04524886877828054, (0, 2): 0.9457013574660633}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 209.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=215.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9720930232558139, (2, 1): 0.018604651162790697, (2, 2): 0.009302325581395349}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9720930232558139, (2, 1): 0.018604651162790697, (2, 2): 0.009302325581395349}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 209.0 -> 210.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 209.0 -> 210.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 250.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=252.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003968253968253968, (0, 1): 0.9920634920634921, (0, 2): 0.003968253968253968}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.003968253968253968, (0, 1): 0.9920634920634921, (0, 2): 0.003968253968253968}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 250.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=255.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9803921568627451, (1, 1): 0.00392156862745098, (1, 2): 0.01568627450980392}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9803921568627451, (1, 1): 0.00392156862745098, (1, 2): 0.01568627450980392}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 250.0 -> 251.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 250.0 -> 251.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 187.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=198.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.045454545454545456, (2, 1): 0.9444444444444444, (2, 2): 0.010101010101010102}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.045454545454545456, (2, 1): 0.9444444444444444, (2, 2): 0.010101010101010102}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 187.0}
in get_filtered_urn(filter=1) --- total: total=199.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05025125628140704, (1, 1): 0.010050251256281407, (1, 2): 0.9396984924623115}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05025125628140704, (1, 1): 0.010050251256281407, (1, 2): 0.9396984924623115}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 187.0 -> 188.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 187.0 -> 188.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 251.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=253.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003952569169960474, (0, 1): 0.9920948616600791, (0, 2): 0.003952569169960474}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.003952569169960474, (0, 1): 0.9920948616600791, (0, 2): 0.003952569169960474}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 251.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=256.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.98046875, (1, 1): 0.00390625, (1, 2): 0.015625}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.98046875, (1, 1): 0.00390625, (1, 2): 0.015625}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 251.0 -> 252.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 251.0 -> 252.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 188.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=199.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04522613065326633, (2, 1): 0.9447236180904522, (2, 2): 0.010050251256281407}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04522613065326633, (2, 1): 0.9447236180904522, (2, 2): 0.010050251256281407}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 188.0}
in get_filtered_urn(filter=1) --- total: total=200.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.05, (1, 1): 0.01, (1, 2): 0.94}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.05, (1, 1): 0.01, (1, 2): 0.94}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 188.0 -> 189.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 188.0 -> 189.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 230.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=235.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9787234042553191, (2, 1): 0.01702127659574468, (2, 2): 0.00425531914893617}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9787234042553191, (2, 1): 0.01702127659574468, (2, 2): 0.00425531914893617}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 230.0}
in get_filtered_urn(filter=0) --- total: total=232.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004310344827586207, (0, 1): 0.004310344827586207, (0, 2): 0.9913793103448276}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004310344827586207, (0, 1): 0.004310344827586207, (0, 2): 0.9913793103448276}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 230.0 -> 231.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 230.0 -> 231.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 189.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=200.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.045, (2, 1): 0.945, (2, 2): 0.01}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.045, (2, 1): 0.945, (2, 2): 0.01}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 189.0}
in get_filtered_urn(filter=1) --- total: total=201.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04975124378109453, (1, 1): 0.009950248756218905, (1, 2): 0.9402985074626866}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04975124378109453, (1, 1): 0.009950248756218905, (1, 2): 0.9402985074626866}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 189.0 -> 190.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 189.0 -> 190.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 291.0}
in get_filtered_urn(filter=1) --- total: total=293.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0034129692832764505, (1, 1): 0.0034129692832764505, (1, 2): 0.9931740614334471}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0034129692832764505, (1, 1): 0.0034129692832764505, (1, 2): 0.9931740614334471}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 291.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=293.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0034129692832764505, (2, 1): 0.9931740614334471, (2, 2): 0.0034129692832764505}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0034129692832764505, (2, 1): 0.9931740614334471, (2, 2): 0.0034129692832764505}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 291.0 -> 292.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 291.0 -> 292.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 210.0}
in get_filtered_urn(filter=0) --- total: total=222.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009009009009009009, (0, 1): 0.04504504504504504, (0, 2): 0.9459459459459459}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.009009009009009009, (0, 1): 0.04504504504504504, (0, 2): 0.9459459459459459}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 210.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=216.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9722222222222222, (2, 1): 0.018518518518518517, (2, 2): 0.009259259259259259}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9722222222222222, (2, 1): 0.018518518518518517, (2, 2): 0.009259259259259259}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 210.0 -> 211.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 210.0 -> 211.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 292.0}
in get_filtered_urn(filter=1) --- total: total=294.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003401360544217687, (1, 1): 0.003401360544217687, (1, 2): 0.9931972789115646}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003401360544217687, (1, 1): 0.003401360544217687, (1, 2): 0.9931972789115646}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 292.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=294.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003401360544217687, (2, 1): 0.9931972789115646, (2, 2): 0.003401360544217687}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003401360544217687, (2, 1): 0.9931972789115646, (2, 2): 0.003401360544217687}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 292.0 -> 293.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 292.0 -> 293.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 190.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=201.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04477611940298507, (2, 1): 0.945273631840796, (2, 2): 0.009950248756218905}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04477611940298507, (2, 1): 0.945273631840796, (2, 2): 0.009950248756218905}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 190.0}
in get_filtered_urn(filter=1) --- total: total=202.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04950495049504951, (1, 1): 0.009900990099009901, (1, 2): 0.9405940594059405}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04950495049504951, (1, 1): 0.009900990099009901, (1, 2): 0.9405940594059405}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 190.0 -> 191.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 190.0 -> 191.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 231.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=236.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9788135593220338, (2, 1): 0.01694915254237288, (2, 2): 0.00423728813559322}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9788135593220338, (2, 1): 0.01694915254237288, (2, 2): 0.00423728813559322}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 231.0}
in get_filtered_urn(filter=0) --- total: total=233.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004291845493562232, (0, 1): 0.004291845493562232, (0, 2): 0.9914163090128756}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004291845493562232, (0, 1): 0.004291845493562232, (0, 2): 0.9914163090128756}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 231.0 -> 232.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 231.0 -> 232.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 211.0}
in get_filtered_urn(filter=0) --- total: total=223.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008968609865470852, (0, 1): 0.04484304932735426, (0, 2): 0.9461883408071748}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008968609865470852, (0, 1): 0.04484304932735426, (0, 2): 0.9461883408071748}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 211.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=217.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9723502304147466, (2, 1): 0.018433179723502304, (2, 2): 0.009216589861751152}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9723502304147466, (2, 1): 0.018433179723502304, (2, 2): 0.009216589861751152}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 211.0 -> 212.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 211.0 -> 212.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 232.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=237.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9789029535864979, (2, 1): 0.016877637130801686, (2, 2): 0.004219409282700422}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9789029535864979, (2, 1): 0.016877637130801686, (2, 2): 0.004219409282700422}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 232.0}
in get_filtered_urn(filter=0) --- total: total=234.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004273504273504274, (0, 1): 0.004273504273504274, (0, 2): 0.9914529914529915}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004273504273504274, (0, 1): 0.004273504273504274, (0, 2): 0.9914529914529915}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 232.0 -> 233.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 232.0 -> 233.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 191.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=202.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04455445544554455, (2, 1): 0.9455445544554455, (2, 2): 0.009900990099009901}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04455445544554455, (2, 1): 0.9455445544554455, (2, 2): 0.009900990099009901}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 191.0}
in get_filtered_urn(filter=1) --- total: total=203.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04926108374384237, (1, 1): 0.009852216748768473, (1, 2): 0.9408866995073891}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04926108374384237, (1, 1): 0.009852216748768473, (1, 2): 0.9408866995073891}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 191.0 -> 192.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 191.0 -> 192.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 293.0}
in get_filtered_urn(filter=1) --- total: total=295.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003389830508474576, (1, 1): 0.003389830508474576, (1, 2): 0.9932203389830508}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003389830508474576, (1, 1): 0.003389830508474576, (1, 2): 0.9932203389830508}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 293.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=295.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003389830508474576, (2, 1): 0.9932203389830508, (2, 2): 0.003389830508474576}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003389830508474576, (2, 1): 0.9932203389830508, (2, 2): 0.003389830508474576}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 293.0 -> 294.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 293.0 -> 294.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 207.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=213.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.971830985915493, (1, 1): 0.009389671361502348, (1, 2): 0.018779342723004695}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.971830985915493, (1, 1): 0.009389671361502348, (1, 2): 0.018779342723004695}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 207.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=218.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009174311926605505, (0, 1): 0.9495412844036697, (0, 2): 0.04128440366972477}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009174311926605505, (0, 1): 0.9495412844036697, (0, 2): 0.04128440366972477}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 207.0 -> 208.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 207.0 -> 208.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 252.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=254.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003937007874015748, (0, 1): 0.9921259842519685, (0, 2): 0.003937007874015748}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.003937007874015748, (0, 1): 0.9921259842519685, (0, 2): 0.003937007874015748}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 252.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=257.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.980544747081712, (1, 1): 0.0038910505836575876, (1, 2): 0.01556420233463035}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.980544747081712, (1, 1): 0.0038910505836575876, (1, 2): 0.01556420233463035}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 252.0 -> 253.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 252.0 -> 253.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 208.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=214.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9719626168224299, (1, 1): 0.009345794392523364, (1, 2): 0.018691588785046728}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9719626168224299, (1, 1): 0.009345794392523364, (1, 2): 0.018691588785046728}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 208.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=219.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0091324200913242, (0, 1): 0.9497716894977168, (0, 2): 0.0410958904109589}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0091324200913242, (0, 1): 0.9497716894977168, (0, 2): 0.0410958904109589}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 208.0 -> 209.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 208.0 -> 209.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 253.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=255.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00392156862745098, (0, 1): 0.9921568627450981, (0, 2): 0.00392156862745098}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00392156862745098, (0, 1): 0.9921568627450981, (0, 2): 0.00392156862745098}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 253.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=258.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9806201550387597, (1, 1): 0.003875968992248062, (1, 2): 0.015503875968992248}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9806201550387597, (1, 1): 0.003875968992248062, (1, 2): 0.015503875968992248}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 253.0 -> 254.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 253.0 -> 254.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 209.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=215.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9720930232558139, (1, 1): 0.009302325581395349, (1, 2): 0.018604651162790697}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9720930232558139, (1, 1): 0.009302325581395349, (1, 2): 0.018604651162790697}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 209.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=220.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00909090909090909, (0, 1): 0.95, (0, 2): 0.04090909090909091}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00909090909090909, (0, 1): 0.95, (0, 2): 0.04090909090909091}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 209.0 -> 210.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 209.0 -> 210.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 294.0}
in get_filtered_urn(filter=1) --- total: total=296.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0033783783783783786, (1, 1): 0.0033783783783783786, (1, 2): 0.9932432432432432}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0033783783783783786, (1, 1): 0.0033783783783783786, (1, 2): 0.9932432432432432}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 294.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=296.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0033783783783783786, (2, 1): 0.9932432432432432, (2, 2): 0.0033783783783783786}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0033783783783783786, (2, 1): 0.9932432432432432, (2, 2): 0.0033783783783783786}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 294.0 -> 295.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 294.0 -> 295.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 212.0}
in get_filtered_urn(filter=0) --- total: total=224.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008928571428571428, (0, 1): 0.044642857142857144, (0, 2): 0.9464285714285714}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008928571428571428, (0, 1): 0.044642857142857144, (0, 2): 0.9464285714285714}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 212.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=218.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9724770642201835, (2, 1): 0.01834862385321101, (2, 2): 0.009174311926605505}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9724770642201835, (2, 1): 0.01834862385321101, (2, 2): 0.009174311926605505}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 212.0 -> 213.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 212.0 -> 213.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 233.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=238.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9789915966386554, (2, 1): 0.01680672268907563, (2, 2): 0.004201680672268907}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9789915966386554, (2, 1): 0.01680672268907563, (2, 2): 0.004201680672268907}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 233.0}
in get_filtered_urn(filter=0) --- total: total=235.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00425531914893617, (0, 1): 0.00425531914893617, (0, 2): 0.9914893617021276}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00425531914893617, (0, 1): 0.00425531914893617, (0, 2): 0.9914893617021276}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 233.0 -> 234.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 233.0 -> 234.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 192.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=203.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04433497536945813, (2, 1): 0.9458128078817734, (2, 2): 0.009852216748768473}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04433497536945813, (2, 1): 0.9458128078817734, (2, 2): 0.009852216748768473}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 192.0}
in get_filtered_urn(filter=1) --- total: total=204.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.049019607843137254, (1, 1): 0.00980392156862745, (1, 2): 0.9411764705882353}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.049019607843137254, (1, 1): 0.00980392156862745, (1, 2): 0.9411764705882353}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 192.0 -> 192.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 295.0}
in get_filtered_urn(filter=1) --- total: total=297.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003367003367003367, (1, 1): 0.003367003367003367, (1, 2): 0.9932659932659933}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003367003367003367, (1, 1): 0.003367003367003367, (1, 2): 0.9932659932659933}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 295.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=297.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003367003367003367, (2, 1): 0.9932659932659933, (2, 2): 0.003367003367003367}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003367003367003367, (2, 1): 0.9932659932659933, (2, 2): 0.003367003367003367}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 295.0 -> 296.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 295.0 -> 296.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 210.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=216.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9722222222222222, (1, 1): 0.009259259259259259, (1, 2): 0.018518518518518517}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9722222222222222, (1, 1): 0.009259259259259259, (1, 2): 0.018518518518518517}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 210.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=221.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00904977375565611, (0, 1): 0.9502262443438914, (0, 2): 0.04072398190045249}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00904977375565611, (0, 1): 0.9502262443438914, (0, 2): 0.04072398190045249}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 210.0 -> 211.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 210.0 -> 211.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 296.0}
in get_filtered_urn(filter=1) --- total: total=298.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003355704697986577, (1, 1): 0.003355704697986577, (1, 2): 0.9932885906040269}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003355704697986577, (1, 1): 0.003355704697986577, (1, 2): 0.9932885906040269}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 296.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=298.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003355704697986577, (2, 1): 0.9932885906040269, (2, 2): 0.003355704697986577}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003355704697986577, (2, 1): 0.9932885906040269, (2, 2): 0.003355704697986577}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 296.0 -> 297.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 296.0 -> 297.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 213.0}
in get_filtered_urn(filter=0) --- total: total=225.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008888888888888889, (0, 1): 0.044444444444444446, (0, 2): 0.9466666666666667}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.008888888888888889, (0, 1): 0.044444444444444446, (0, 2): 0.9466666666666667}
Sender 4 got filter 0 choose option: (0, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 211.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=222.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009009009009009009, (0, 1): 0.9504504504504504, (0, 2): 0.04054054054054054}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009009009009009009, (0, 1): 0.9504504504504504, (0, 2): 0.04054054054054054}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 0): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 211.0 -> 211.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 297.0}
in get_filtered_urn(filter=1) --- total: total=299.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0033444816053511705, (1, 1): 0.0033444816053511705, (1, 2): 0.9933110367892977}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0033444816053511705, (1, 1): 0.0033444816053511705, (1, 2): 0.9933110367892977}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 297.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=299.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0033444816053511705, (2, 1): 0.9933110367892977, (2, 2): 0.0033444816053511705}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0033444816053511705, (2, 1): 0.9933110367892977, (2, 2): 0.0033444816053511705}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 297.0 -> 298.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 297.0 -> 298.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 192.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=203.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04433497536945813, (2, 1): 0.9458128078817734, (2, 2): 0.009852216748768473}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04433497536945813, (2, 1): 0.9458128078817734, (2, 2): 0.009852216748768473}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 192.0}
in get_filtered_urn(filter=1) --- total: total=204.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.049019607843137254, (1, 1): 0.00980392156862745, (1, 2): 0.9411764705882353}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.049019607843137254, (1, 1): 0.00980392156862745, (1, 2): 0.9411764705882353}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 192.0 -> 193.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 192.0 -> 193.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 234.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=239.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9790794979079498, (2, 1): 0.016736401673640166, (2, 2): 0.0041841004184100415}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9790794979079498, (2, 1): 0.016736401673640166, (2, 2): 0.0041841004184100415}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 234.0}
in get_filtered_urn(filter=0) --- total: total=236.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00423728813559322, (0, 1): 0.00423728813559322, (0, 2): 0.9915254237288136}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00423728813559322, (0, 1): 0.00423728813559322, (0, 2): 0.9915254237288136}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 234.0 -> 235.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 234.0 -> 235.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 193.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=204.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04411764705882353, (2, 1): 0.946078431372549, (2, 2): 0.00980392156862745}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04411764705882353, (2, 1): 0.946078431372549, (2, 2): 0.00980392156862745}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 193.0}
in get_filtered_urn(filter=1) --- total: total=205.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04878048780487805, (1, 1): 0.00975609756097561, (1, 2): 0.9414634146341463}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.04878048780487805, (1, 1): 0.00975609756097561, (1, 2): 0.9414634146341463}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 193.0 -> 193.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 235.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=240.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9791666666666666, (2, 1): 0.016666666666666666, (2, 2): 0.004166666666666667}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9791666666666666, (2, 1): 0.016666666666666666, (2, 2): 0.004166666666666667}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 235.0}
in get_filtered_urn(filter=0) --- total: total=237.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004219409282700422, (0, 1): 0.004219409282700422, (0, 2): 0.9915611814345991}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004219409282700422, (0, 1): 0.004219409282700422, (0, 2): 0.9915611814345991}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 235.0 -> 236.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 235.0 -> 236.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 213.0}
in get_filtered_urn(filter=0) --- total: total=225.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008888888888888889, (0, 1): 0.044444444444444446, (0, 2): 0.9466666666666667}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008888888888888889, (0, 1): 0.044444444444444446, (0, 2): 0.9466666666666667}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 213.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=219.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9726027397260274, (2, 1): 0.0182648401826484, (2, 2): 0.0091324200913242}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9726027397260274, (2, 1): 0.0182648401826484, (2, 2): 0.0091324200913242}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 213.0 -> 214.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 213.0 -> 214.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 298.0}
in get_filtered_urn(filter=1) --- total: total=300.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0033333333333333335, (1, 1): 0.0033333333333333335, (1, 2): 0.9933333333333333}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0033333333333333335, (1, 1): 0.0033333333333333335, (1, 2): 0.9933333333333333}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 298.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=300.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0033333333333333335, (2, 1): 0.9933333333333333, (2, 2): 0.0033333333333333335}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0033333333333333335, (2, 1): 0.9933333333333333, (2, 2): 0.0033333333333333335}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 298.0 -> 299.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 298.0 -> 299.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 193.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=204.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04411764705882353, (2, 1): 0.946078431372549, (2, 2): 0.00980392156862745}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04411764705882353, (2, 1): 0.946078431372549, (2, 2): 0.00980392156862745}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 193.0}
in get_filtered_urn(filter=1) --- total: total=205.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04878048780487805, (1, 1): 0.00975609756097561, (1, 2): 0.9414634146341463}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04878048780487805, (1, 1): 0.00975609756097561, (1, 2): 0.9414634146341463}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 193.0 -> 194.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 193.0 -> 194.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 236.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=241.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.979253112033195, (2, 1): 0.016597510373443983, (2, 2): 0.004149377593360996}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.979253112033195, (2, 1): 0.016597510373443983, (2, 2): 0.004149377593360996}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 236.0}
in get_filtered_urn(filter=0) --- total: total=238.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004201680672268907, (0, 1): 0.004201680672268907, (0, 2): 0.9915966386554622}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004201680672268907, (0, 1): 0.004201680672268907, (0, 2): 0.9915966386554622}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 236.0 -> 237.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 236.0 -> 237.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 211.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=217.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9723502304147466, (1, 1): 0.009216589861751152, (1, 2): 0.018433179723502304}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9723502304147466, (1, 1): 0.009216589861751152, (1, 2): 0.018433179723502304}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 211.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=222.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.009009009009009009, (0, 1): 0.9504504504504504, (0, 2): 0.04054054054054054}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.009009009009009009, (0, 1): 0.9504504504504504, (0, 2): 0.04054054054054054}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 211.0 -> 212.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 211.0 -> 212.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 254.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=256.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00390625, (0, 1): 0.9921875, (0, 2): 0.00390625}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00390625, (0, 1): 0.9921875, (0, 2): 0.00390625}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 254.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=259.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9806949806949807, (1, 1): 0.003861003861003861, (1, 2): 0.015444015444015444}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9806949806949807, (1, 1): 0.003861003861003861, (1, 2): 0.015444015444015444}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 254.0 -> 255.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 254.0 -> 255.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 212.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=218.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9724770642201835, (1, 1): 0.009174311926605505, (1, 2): 0.01834862385321101}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9724770642201835, (1, 1): 0.009174311926605505, (1, 2): 0.01834862385321101}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 212.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=223.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008968609865470852, (0, 1): 0.9506726457399103, (0, 2): 0.04035874439461883}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008968609865470852, (0, 1): 0.9506726457399103, (0, 2): 0.04035874439461883}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 212.0 -> 213.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 212.0 -> 213.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 299.0}
in get_filtered_urn(filter=1) --- total: total=301.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0033222591362126247, (1, 1): 0.0033222591362126247, (1, 2): 0.9933554817275747}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0033222591362126247, (1, 1): 0.0033222591362126247, (1, 2): 0.9933554817275747}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 299.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=301.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0033222591362126247, (2, 1): 0.9933554817275747, (2, 2): 0.0033222591362126247}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0033222591362126247, (2, 1): 0.9933554817275747, (2, 2): 0.0033222591362126247}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 299.0 -> 300.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 299.0 -> 300.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 213.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=219.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9726027397260274, (1, 1): 0.0091324200913242, (1, 2): 0.0182648401826484}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9726027397260274, (1, 1): 0.0091324200913242, (1, 2): 0.0182648401826484}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 213.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=224.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008928571428571428, (0, 1): 0.9508928571428571, (0, 2): 0.04017857142857143}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008928571428571428, (0, 1): 0.9508928571428571, (0, 2): 0.04017857142857143}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 213.0 -> 214.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 213.0 -> 214.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 255.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=257.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0038910505836575876, (0, 1): 0.9922178988326849, (0, 2): 0.0038910505836575876}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0038910505836575876, (0, 1): 0.9922178988326849, (0, 2): 0.0038910505836575876}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 255.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=260.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9807692307692307, (1, 1): 0.0038461538461538464, (1, 2): 0.015384615384615385}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9807692307692307, (1, 1): 0.0038461538461538464, (1, 2): 0.015384615384615385}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 255.0 -> 256.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 255.0 -> 256.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 194.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=205.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04390243902439024, (2, 1): 0.9463414634146341, (2, 2): 0.00975609756097561}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04390243902439024, (2, 1): 0.9463414634146341, (2, 2): 0.00975609756097561}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 194.0}
in get_filtered_urn(filter=1) --- total: total=206.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04854368932038835, (1, 1): 0.009708737864077669, (1, 2): 0.941747572815534}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04854368932038835, (1, 1): 0.009708737864077669, (1, 2): 0.941747572815534}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 194.0 -> 195.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 194.0 -> 195.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 300.0}
in get_filtered_urn(filter=1) --- total: total=302.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0033112582781456954, (1, 1): 0.0033112582781456954, (1, 2): 0.9933774834437086}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0033112582781456954, (1, 1): 0.0033112582781456954, (1, 2): 0.9933774834437086}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 300.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=302.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0033112582781456954, (2, 1): 0.9933774834437086, (2, 2): 0.0033112582781456954}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0033112582781456954, (2, 1): 0.9933774834437086, (2, 2): 0.0033112582781456954}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 300.0 -> 301.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 300.0 -> 301.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 195.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=206.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.043689320388349516, (2, 1): 0.9466019417475728, (2, 2): 0.009708737864077669}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.043689320388349516, (2, 1): 0.9466019417475728, (2, 2): 0.009708737864077669}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 195.0}
in get_filtered_urn(filter=1) --- total: total=207.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04830917874396135, (1, 1): 0.00966183574879227, (1, 2): 0.9420289855072463}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04830917874396135, (1, 1): 0.00966183574879227, (1, 2): 0.9420289855072463}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 195.0 -> 196.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 195.0 -> 196.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 256.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=258.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003875968992248062, (0, 1): 0.9922480620155039, (0, 2): 0.003875968992248062}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.003875968992248062, (0, 1): 0.9922480620155039, (0, 2): 0.003875968992248062}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 256.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=261.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9808429118773946, (1, 1): 0.0038314176245210726, (1, 2): 0.01532567049808429}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9808429118773946, (1, 1): 0.0038314176245210726, (1, 2): 0.01532567049808429}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 256.0 -> 257.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 256.0 -> 257.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 196.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=207.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.043478260869565216, (2, 1): 0.9468599033816425, (2, 2): 0.00966183574879227}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.043478260869565216, (2, 1): 0.9468599033816425, (2, 2): 0.00966183574879227}
Sender 4 got filter 2 choose option: (2, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 214.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=225.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008888888888888889, (0, 1): 0.9511111111111111, (0, 2): 0.04}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008888888888888889, (0, 1): 0.9511111111111111, (0, 2): 0.04}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 0): 9.0 -> 9.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 214.0 -> 214.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 237.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=242.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9793388429752066, (2, 1): 0.01652892561983471, (2, 2): 0.004132231404958678}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9793388429752066, (2, 1): 0.01652892561983471, (2, 2): 0.004132231404958678}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 237.0}
in get_filtered_urn(filter=0) --- total: total=239.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0041841004184100415, (0, 1): 0.0041841004184100415, (0, 2): 0.9916317991631799}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0041841004184100415, (0, 1): 0.0041841004184100415, (0, 2): 0.9916317991631799}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 237.0 -> 238.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 237.0 -> 238.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 196.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=207.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.043478260869565216, (2, 1): 0.9468599033816425, (2, 2): 0.00966183574879227}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.043478260869565216, (2, 1): 0.9468599033816425, (2, 2): 0.00966183574879227}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 196.0}
in get_filtered_urn(filter=1) --- total: total=208.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04807692307692308, (1, 1): 0.009615384615384616, (1, 2): 0.9423076923076923}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04807692307692308, (1, 1): 0.009615384615384616, (1, 2): 0.9423076923076923}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 196.0 -> 197.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 196.0 -> 197.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 257.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=259.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003861003861003861, (0, 1): 0.9922779922779923, (0, 2): 0.003861003861003861}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.003861003861003861, (0, 1): 0.9922779922779923, (0, 2): 0.003861003861003861}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 257.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=262.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9809160305343512, (1, 1): 0.003816793893129771, (1, 2): 0.015267175572519083}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9809160305343512, (1, 1): 0.003816793893129771, (1, 2): 0.015267175572519083}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 257.0 -> 258.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 257.0 -> 258.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 197.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=208.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04326923076923077, (2, 1): 0.9471153846153846, (2, 2): 0.009615384615384616}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04326923076923077, (2, 1): 0.9471153846153846, (2, 2): 0.009615384615384616}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 197.0}
in get_filtered_urn(filter=1) --- total: total=209.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04784688995215311, (1, 1): 0.009569377990430622, (1, 2): 0.9425837320574163}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04784688995215311, (1, 1): 0.009569377990430622, (1, 2): 0.9425837320574163}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 197.0 -> 198.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 197.0 -> 198.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 238.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=243.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9794238683127572, (2, 1): 0.01646090534979424, (2, 2): 0.00411522633744856}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9794238683127572, (2, 1): 0.01646090534979424, (2, 2): 0.00411522633744856}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 238.0}
in get_filtered_urn(filter=0) --- total: total=240.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004166666666666667, (0, 1): 0.004166666666666667, (0, 2): 0.9916666666666667}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004166666666666667, (0, 1): 0.004166666666666667, (0, 2): 0.9916666666666667}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 238.0 -> 239.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 238.0 -> 239.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 214.0}
in get_filtered_urn(filter=0) --- total: total=226.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008849557522123894, (0, 1): 0.04424778761061947, (0, 2): 0.9469026548672567}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 0) from urn={(0, 0): 0.008849557522123894, (0, 1): 0.04424778761061947, (0, 2): 0.9469026548672567}
Sender 4 got filter 0 choose option: (0, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 214.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=225.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008888888888888889, (0, 1): 0.9511111111111111, (0, 2): 0.04}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008888888888888889, (0, 1): 0.9511111111111111, (0, 2): 0.04}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 0): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (0, 1): 214.0 -> 214.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 258.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=260.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0038461538461538464, (0, 1): 0.9923076923076923, (0, 2): 0.0038461538461538464}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0038461538461538464, (0, 1): 0.9923076923076923, (0, 2): 0.0038461538461538464}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 258.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=263.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9809885931558935, (1, 1): 0.0038022813688212928, (1, 2): 0.015209125475285171}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9809885931558935, (1, 1): 0.0038022813688212928, (1, 2): 0.015209125475285171}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 258.0 -> 259.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 258.0 -> 259.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 214.0}
in get_filtered_urn(filter=0) --- total: total=226.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008849557522123894, (0, 1): 0.04424778761061947, (0, 2): 0.9469026548672567}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008849557522123894, (0, 1): 0.04424778761061947, (0, 2): 0.9469026548672567}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 198.0}
in get_filtered_urn(filter=1) --- total: total=210.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.047619047619047616, (1, 1): 0.009523809523809525, (1, 2): 0.9428571428571428}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.047619047619047616, (1, 1): 0.009523809523809525, (1, 2): 0.9428571428571428}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 198.0 -> 198.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 259.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=261.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0038314176245210726, (0, 1): 0.9923371647509579, (0, 2): 0.0038314176245210726}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0038314176245210726, (0, 1): 0.9923371647509579, (0, 2): 0.0038314176245210726}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 259.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=264.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9810606060606061, (1, 1): 0.003787878787878788, (1, 2): 0.015151515151515152}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9810606060606061, (1, 1): 0.003787878787878788, (1, 2): 0.015151515151515152}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 259.0 -> 260.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 259.0 -> 260.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 214.0}
in get_filtered_urn(filter=0) --- total: total=226.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008849557522123894, (0, 1): 0.04424778761061947, (0, 2): 0.9469026548672567}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008849557522123894, (0, 1): 0.04424778761061947, (0, 2): 0.9469026548672567}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 214.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=220.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9727272727272728, (2, 1): 0.01818181818181818, (2, 2): 0.00909090909090909}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9727272727272728, (2, 1): 0.01818181818181818, (2, 2): 0.00909090909090909}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 214.0 -> 215.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 214.0 -> 215.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 301.0}
in get_filtered_urn(filter=1) --- total: total=303.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0033003300330033004, (1, 1): 0.0033003300330033004, (1, 2): 0.9933993399339934}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0033003300330033004, (1, 1): 0.0033003300330033004, (1, 2): 0.9933993399339934}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 301.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=303.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0033003300330033004, (2, 1): 0.9933993399339934, (2, 2): 0.0033003300330033004}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0033003300330033004, (2, 1): 0.9933993399339934, (2, 2): 0.0033003300330033004}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 301.0 -> 302.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 301.0 -> 302.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 215.0}
in get_filtered_urn(filter=0) --- total: total=227.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00881057268722467, (0, 1): 0.04405286343612335, (0, 2): 0.947136563876652}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00881057268722467, (0, 1): 0.04405286343612335, (0, 2): 0.947136563876652}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 215.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=221.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9728506787330317, (2, 1): 0.01809954751131222, (2, 2): 0.00904977375565611}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9728506787330317, (2, 1): 0.01809954751131222, (2, 2): 0.00904977375565611}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 215.0 -> 216.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 215.0 -> 216.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 302.0}
in get_filtered_urn(filter=1) --- total: total=304.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003289473684210526, (1, 1): 0.003289473684210526, (1, 2): 0.993421052631579}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003289473684210526, (1, 1): 0.003289473684210526, (1, 2): 0.993421052631579}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 302.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=304.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003289473684210526, (2, 1): 0.993421052631579, (2, 2): 0.003289473684210526}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003289473684210526, (2, 1): 0.993421052631579, (2, 2): 0.003289473684210526}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 302.0 -> 303.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 302.0 -> 303.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 216.0}
in get_filtered_urn(filter=0) --- total: total=228.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008771929824561403, (0, 1): 0.043859649122807015, (0, 2): 0.9473684210526315}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008771929824561403, (0, 1): 0.043859649122807015, (0, 2): 0.9473684210526315}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 216.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=222.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.972972972972973, (2, 1): 0.018018018018018018, (2, 2): 0.009009009009009009}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.972972972972973, (2, 1): 0.018018018018018018, (2, 2): 0.009009009009009009}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 216.0 -> 217.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 216.0 -> 217.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 260.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=262.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003816793893129771, (0, 1): 0.9923664122137404, (0, 2): 0.003816793893129771}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.003816793893129771, (0, 1): 0.9923664122137404, (0, 2): 0.003816793893129771}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 260.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=265.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9811320754716981, (1, 1): 0.0037735849056603774, (1, 2): 0.01509433962264151}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9811320754716981, (1, 1): 0.0037735849056603774, (1, 2): 0.01509433962264151}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 260.0 -> 261.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 260.0 -> 261.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 198.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=209.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0430622009569378, (2, 1): 0.9473684210526315, (2, 2): 0.009569377990430622}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0430622009569378, (2, 1): 0.9473684210526315, (2, 2): 0.009569377990430622}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 198.0}
in get_filtered_urn(filter=1) --- total: total=210.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.047619047619047616, (1, 1): 0.009523809523809525, (1, 2): 0.9428571428571428}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.047619047619047616, (1, 1): 0.009523809523809525, (1, 2): 0.9428571428571428}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 198.0 -> 199.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 198.0 -> 199.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 239.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=244.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9795081967213115, (2, 1): 0.01639344262295082, (2, 2): 0.004098360655737705}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9795081967213115, (2, 1): 0.01639344262295082, (2, 2): 0.004098360655737705}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 239.0}
in get_filtered_urn(filter=0) --- total: total=241.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004149377593360996, (0, 1): 0.004149377593360996, (0, 2): 0.991701244813278}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004149377593360996, (0, 1): 0.004149377593360996, (0, 2): 0.991701244813278}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 239.0 -> 240.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 239.0 -> 240.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 199.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=210.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04285714285714286, (2, 1): 0.9476190476190476, (2, 2): 0.009523809523809525}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04285714285714286, (2, 1): 0.9476190476190476, (2, 2): 0.009523809523809525}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 199.0}
in get_filtered_urn(filter=1) --- total: total=211.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04739336492890995, (1, 1): 0.009478672985781991, (1, 2): 0.943127962085308}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.04739336492890995, (1, 1): 0.009478672985781991, (1, 2): 0.943127962085308}
in decode_message(signal=1) Receiver 5 got option: (1, 0) and decoded action: 0
Receiver 5 received signals: [1] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (2, 1): 199.0 -> 199.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 0): 10.0 -> 10.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 261.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=263.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0038022813688212928, (0, 1): 0.9923954372623575, (0, 2): 0.0038022813688212928}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0038022813688212928, (0, 1): 0.9923954372623575, (0, 2): 0.0038022813688212928}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 261.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=266.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.981203007518797, (1, 1): 0.0037593984962406013, (1, 2): 0.015037593984962405}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.981203007518797, (1, 1): 0.0037593984962406013, (1, 2): 0.015037593984962405}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 261.0 -> 262.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 261.0 -> 262.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 217.0}
in get_filtered_urn(filter=0) --- total: total=229.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008733624454148471, (0, 1): 0.043668122270742356, (0, 2): 0.9475982532751092}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008733624454148471, (0, 1): 0.043668122270742356, (0, 2): 0.9475982532751092}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 217.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=223.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9730941704035875, (2, 1): 0.017937219730941704, (2, 2): 0.008968609865470852}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9730941704035875, (2, 1): 0.017937219730941704, (2, 2): 0.008968609865470852}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 217.0 -> 218.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 217.0 -> 218.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 262.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=264.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003787878787878788, (0, 1): 0.9924242424242424, (0, 2): 0.003787878787878788}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.003787878787878788, (0, 1): 0.9924242424242424, (0, 2): 0.003787878787878788}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 262.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=267.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9812734082397003, (1, 1): 0.003745318352059925, (1, 2): 0.0149812734082397}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9812734082397003, (1, 1): 0.003745318352059925, (1, 2): 0.0149812734082397}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 262.0 -> 263.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 262.0 -> 263.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 218.0}
in get_filtered_urn(filter=0) --- total: total=230.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008695652173913044, (0, 1): 0.043478260869565216, (0, 2): 0.9478260869565217}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008695652173913044, (0, 1): 0.043478260869565216, (0, 2): 0.9478260869565217}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 218.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=224.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9732142857142857, (2, 1): 0.017857142857142856, (2, 2): 0.008928571428571428}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9732142857142857, (2, 1): 0.017857142857142856, (2, 2): 0.008928571428571428}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 218.0 -> 219.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 218.0 -> 219.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 240.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=245.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9795918367346939, (2, 1): 0.0163265306122449, (2, 2): 0.004081632653061225}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9795918367346939, (2, 1): 0.0163265306122449, (2, 2): 0.004081632653061225}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 240.0}
in get_filtered_urn(filter=0) --- total: total=242.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004132231404958678, (0, 1): 0.004132231404958678, (0, 2): 0.9917355371900827}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004132231404958678, (0, 1): 0.004132231404958678, (0, 2): 0.9917355371900827}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 240.0 -> 241.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 240.0 -> 241.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 199.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=210.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04285714285714286, (2, 1): 0.9476190476190476, (2, 2): 0.009523809523809525}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04285714285714286, (2, 1): 0.9476190476190476, (2, 2): 0.009523809523809525}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 199.0}
in get_filtered_urn(filter=1) --- total: total=211.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04739336492890995, (1, 1): 0.009478672985781991, (1, 2): 0.943127962085308}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04739336492890995, (1, 1): 0.009478672985781991, (1, 2): 0.943127962085308}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 199.0 -> 200.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 199.0 -> 200.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 303.0}
in get_filtered_urn(filter=1) --- total: total=305.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003278688524590164, (1, 1): 0.003278688524590164, (1, 2): 0.9934426229508196}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003278688524590164, (1, 1): 0.003278688524590164, (1, 2): 0.9934426229508196}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 303.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=305.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003278688524590164, (2, 1): 0.9934426229508196, (2, 2): 0.003278688524590164}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003278688524590164, (2, 1): 0.9934426229508196, (2, 2): 0.003278688524590164}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 303.0 -> 304.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 303.0 -> 304.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 219.0}
in get_filtered_urn(filter=0) --- total: total=231.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008658008658008658, (0, 1): 0.04329004329004329, (0, 2): 0.948051948051948}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008658008658008658, (0, 1): 0.04329004329004329, (0, 2): 0.948051948051948}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 219.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=225.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9733333333333334, (2, 1): 0.017777777777777778, (2, 2): 0.008888888888888889}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9733333333333334, (2, 1): 0.017777777777777778, (2, 2): 0.008888888888888889}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 219.0 -> 220.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 219.0 -> 220.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 304.0}
in get_filtered_urn(filter=1) --- total: total=306.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0032679738562091504, (1, 1): 0.0032679738562091504, (1, 2): 0.9934640522875817}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0032679738562091504, (1, 1): 0.0032679738562091504, (1, 2): 0.9934640522875817}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 304.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=306.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0032679738562091504, (2, 1): 0.9934640522875817, (2, 2): 0.0032679738562091504}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0032679738562091504, (2, 1): 0.9934640522875817, (2, 2): 0.0032679738562091504}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 304.0 -> 305.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 304.0 -> 305.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 200.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=211.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04265402843601896, (2, 1): 0.9478672985781991, (2, 2): 0.009478672985781991}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04265402843601896, (2, 1): 0.9478672985781991, (2, 2): 0.009478672985781991}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 200.0}
in get_filtered_urn(filter=1) --- total: total=212.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04716981132075472, (1, 1): 0.009433962264150943, (1, 2): 0.9433962264150944}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04716981132075472, (1, 1): 0.009433962264150943, (1, 2): 0.9433962264150944}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 200.0 -> 201.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 200.0 -> 201.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 305.0}
in get_filtered_urn(filter=1) --- total: total=307.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003257328990228013, (1, 1): 0.003257328990228013, (1, 2): 0.993485342019544}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003257328990228013, (1, 1): 0.003257328990228013, (1, 2): 0.993485342019544}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 305.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=307.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003257328990228013, (2, 1): 0.993485342019544, (2, 2): 0.003257328990228013}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003257328990228013, (2, 1): 0.993485342019544, (2, 2): 0.003257328990228013}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 305.0 -> 306.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 305.0 -> 306.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 220.0}
in get_filtered_urn(filter=0) --- total: total=232.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008620689655172414, (0, 1): 0.04310344827586207, (0, 2): 0.9482758620689655}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008620689655172414, (0, 1): 0.04310344827586207, (0, 2): 0.9482758620689655}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 220.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=226.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9734513274336283, (2, 1): 0.017699115044247787, (2, 2): 0.008849557522123894}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9734513274336283, (2, 1): 0.017699115044247787, (2, 2): 0.008849557522123894}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 220.0 -> 221.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 220.0 -> 221.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 306.0}
in get_filtered_urn(filter=1) --- total: total=308.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003246753246753247, (1, 1): 0.003246753246753247, (1, 2): 0.9935064935064936}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003246753246753247, (1, 1): 0.003246753246753247, (1, 2): 0.9935064935064936}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 306.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=308.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003246753246753247, (2, 1): 0.9935064935064936, (2, 2): 0.003246753246753247}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003246753246753247, (2, 1): 0.9935064935064936, (2, 2): 0.003246753246753247}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 306.0 -> 307.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 306.0 -> 307.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 221.0}
in get_filtered_urn(filter=0) --- total: total=233.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008583690987124463, (0, 1): 0.04291845493562232, (0, 2): 0.9484978540772532}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008583690987124463, (0, 1): 0.04291845493562232, (0, 2): 0.9484978540772532}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 201.0}
in get_filtered_urn(filter=1) --- total: total=213.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.046948356807511735, (1, 1): 0.009389671361502348, (1, 2): 0.9436619718309859}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.046948356807511735, (1, 1): 0.009389671361502348, (1, 2): 0.9436619718309859}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 201.0 -> 201.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 263.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=265.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0037735849056603774, (0, 1): 0.9924528301886792, (0, 2): 0.0037735849056603774}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0037735849056603774, (0, 1): 0.9924528301886792, (0, 2): 0.0037735849056603774}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 263.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=268.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9813432835820896, (1, 1): 0.0037313432835820895, (1, 2): 0.014925373134328358}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.9813432835820896, (1, 1): 0.0037313432835820895, (1, 2): 0.014925373134328358}
in decode_message(signal=1) Receiver 2 got option: (1, 2) and decoded action: 2
Receiver 2 received signals: [1] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 1): 263.0 -> 263.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 221.0}
in get_filtered_urn(filter=0) --- total: total=233.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008583690987124463, (0, 1): 0.04291845493562232, (0, 2): 0.9484978540772532}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008583690987124463, (0, 1): 0.04291845493562232, (0, 2): 0.9484978540772532}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 221.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=227.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.973568281938326, (2, 1): 0.01762114537444934, (2, 2): 0.00881057268722467}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.973568281938326, (2, 1): 0.01762114537444934, (2, 2): 0.00881057268722467}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 221.0 -> 222.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 221.0 -> 222.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 241.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=246.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9796747967479674, (2, 1): 0.016260162601626018, (2, 2): 0.0040650406504065045}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9796747967479674, (2, 1): 0.016260162601626018, (2, 2): 0.0040650406504065045}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 241.0}
in get_filtered_urn(filter=0) --- total: total=243.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00411522633744856, (0, 1): 0.00411522633744856, (0, 2): 0.9917695473251029}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00411522633744856, (0, 1): 0.00411522633744856, (0, 2): 0.9917695473251029}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 241.0 -> 242.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 241.0 -> 242.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 222.0}
in get_filtered_urn(filter=0) --- total: total=234.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008547008547008548, (0, 1): 0.042735042735042736, (0, 2): 0.9487179487179487}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008547008547008548, (0, 1): 0.042735042735042736, (0, 2): 0.9487179487179487}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 222.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=228.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9736842105263158, (2, 1): 0.017543859649122806, (2, 2): 0.008771929824561403}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9736842105263158, (2, 1): 0.017543859649122806, (2, 2): 0.008771929824561403}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 222.0 -> 223.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 222.0 -> 223.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 307.0}
in get_filtered_urn(filter=1) --- total: total=309.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003236245954692557, (1, 1): 0.003236245954692557, (1, 2): 0.9935275080906149}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003236245954692557, (1, 1): 0.003236245954692557, (1, 2): 0.9935275080906149}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 307.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=309.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003236245954692557, (2, 1): 0.9935275080906149, (2, 2): 0.003236245954692557}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003236245954692557, (2, 1): 0.9935275080906149, (2, 2): 0.003236245954692557}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 307.0 -> 308.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 307.0 -> 308.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 223.0}
in get_filtered_urn(filter=0) --- total: total=235.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00851063829787234, (0, 1): 0.0425531914893617, (0, 2): 0.948936170212766}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00851063829787234, (0, 1): 0.0425531914893617, (0, 2): 0.948936170212766}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 223.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=229.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9737991266375546, (2, 1): 0.017467248908296942, (2, 2): 0.008733624454148471}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9737991266375546, (2, 1): 0.017467248908296942, (2, 2): 0.008733624454148471}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 223.0 -> 224.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 223.0 -> 224.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 242.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=247.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.979757085020243, (2, 1): 0.016194331983805668, (2, 2): 0.004048582995951417}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.979757085020243, (2, 1): 0.016194331983805668, (2, 2): 0.004048582995951417}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 242.0}
in get_filtered_urn(filter=0) --- total: total=244.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004098360655737705, (0, 1): 0.004098360655737705, (0, 2): 0.9918032786885246}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004098360655737705, (0, 1): 0.004098360655737705, (0, 2): 0.9918032786885246}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 242.0 -> 243.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 242.0 -> 243.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 214.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=220.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9727272727272728, (1, 1): 0.00909090909090909, (1, 2): 0.01818181818181818}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9727272727272728, (1, 1): 0.00909090909090909, (1, 2): 0.01818181818181818}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 214.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=225.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008888888888888889, (0, 1): 0.9511111111111111, (0, 2): 0.04}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008888888888888889, (0, 1): 0.9511111111111111, (0, 2): 0.04}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 214.0 -> 215.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 214.0 -> 215.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 263.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=265.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0037735849056603774, (0, 1): 0.9924528301886792, (0, 2): 0.0037735849056603774}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0037735849056603774, (0, 1): 0.9924528301886792, (0, 2): 0.0037735849056603774}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 263.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=268.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9813432835820896, (1, 1): 0.0037313432835820895, (1, 2): 0.014925373134328358}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9813432835820896, (1, 1): 0.0037313432835820895, (1, 2): 0.014925373134328358}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 263.0 -> 264.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 263.0 -> 264.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 201.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=212.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04245283018867924, (2, 1): 0.9481132075471698, (2, 2): 0.009433962264150943}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04245283018867924, (2, 1): 0.9481132075471698, (2, 2): 0.009433962264150943}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 201.0}
in get_filtered_urn(filter=1) --- total: total=213.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.046948356807511735, (1, 1): 0.009389671361502348, (1, 2): 0.9436619718309859}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.046948356807511735, (1, 1): 0.009389671361502348, (1, 2): 0.9436619718309859}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 201.0 -> 202.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 201.0 -> 202.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 308.0}
in get_filtered_urn(filter=1) --- total: total=310.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0032258064516129032, (1, 1): 0.0032258064516129032, (1, 2): 0.9935483870967742}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0032258064516129032, (1, 1): 0.0032258064516129032, (1, 2): 0.9935483870967742}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 308.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=310.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0032258064516129032, (2, 1): 0.9935483870967742, (2, 2): 0.0032258064516129032}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0032258064516129032, (2, 1): 0.9935483870967742, (2, 2): 0.0032258064516129032}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 308.0 -> 309.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 308.0 -> 309.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 202.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=213.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04225352112676056, (2, 1): 0.9483568075117371, (2, 2): 0.009389671361502348}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04225352112676056, (2, 1): 0.9483568075117371, (2, 2): 0.009389671361502348}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 202.0}
in get_filtered_urn(filter=1) --- total: total=214.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04672897196261682, (1, 1): 0.009345794392523364, (1, 2): 0.9439252336448598}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04672897196261682, (1, 1): 0.009345794392523364, (1, 2): 0.9439252336448598}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 202.0 -> 203.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 202.0 -> 203.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 243.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=248.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9798387096774194, (2, 1): 0.016129032258064516, (2, 2): 0.004032258064516129}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9798387096774194, (2, 1): 0.016129032258064516, (2, 2): 0.004032258064516129}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 243.0}
in get_filtered_urn(filter=0) --- total: total=245.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004081632653061225, (0, 1): 0.004081632653061225, (0, 2): 0.9918367346938776}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004081632653061225, (0, 1): 0.004081632653061225, (0, 2): 0.9918367346938776}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 243.0 -> 244.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 243.0 -> 244.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 203.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=214.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04205607476635514, (2, 1): 0.9485981308411215, (2, 2): 0.009345794392523364}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04205607476635514, (2, 1): 0.9485981308411215, (2, 2): 0.009345794392523364}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 203.0}
in get_filtered_urn(filter=1) --- total: total=215.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.046511627906976744, (1, 1): 0.009302325581395349, (1, 2): 0.9441860465116279}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.046511627906976744, (1, 1): 0.009302325581395349, (1, 2): 0.9441860465116279}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 203.0 -> 204.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 203.0 -> 204.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 244.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=249.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9799196787148594, (2, 1): 0.01606425702811245, (2, 2): 0.004016064257028112}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9799196787148594, (2, 1): 0.01606425702811245, (2, 2): 0.004016064257028112}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 244.0}
in get_filtered_urn(filter=0) --- total: total=246.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0040650406504065045, (0, 1): 0.0040650406504065045, (0, 2): 0.991869918699187}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0040650406504065045, (0, 1): 0.0040650406504065045, (0, 2): 0.991869918699187}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 244.0 -> 245.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 244.0 -> 245.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 224.0}
in get_filtered_urn(filter=0) --- total: total=236.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00847457627118644, (0, 1): 0.0423728813559322, (0, 2): 0.9491525423728814}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00847457627118644, (0, 1): 0.0423728813559322, (0, 2): 0.9491525423728814}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 224.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=230.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9739130434782609, (2, 1): 0.017391304347826087, (2, 2): 0.008695652173913044}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9739130434782609, (2, 1): 0.017391304347826087, (2, 2): 0.008695652173913044}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 224.0 -> 225.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 224.0 -> 225.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 264.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=266.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0037593984962406013, (0, 1): 0.9924812030075187, (0, 2): 0.0037593984962406013}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0037593984962406013, (0, 1): 0.9924812030075187, (0, 2): 0.0037593984962406013}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 264.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=269.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9814126394052045, (1, 1): 0.0037174721189591076, (1, 2): 0.01486988847583643}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9814126394052045, (1, 1): 0.0037174721189591076, (1, 2): 0.01486988847583643}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 264.0 -> 265.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 264.0 -> 265.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 204.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=215.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04186046511627907, (2, 1): 0.9488372093023256, (2, 2): 0.009302325581395349}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04186046511627907, (2, 1): 0.9488372093023256, (2, 2): 0.009302325581395349}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 204.0}
in get_filtered_urn(filter=1) --- total: total=216.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.046296296296296294, (1, 1): 0.009259259259259259, (1, 2): 0.9444444444444444}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.046296296296296294, (1, 1): 0.009259259259259259, (1, 2): 0.9444444444444444}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 204.0 -> 205.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 204.0 -> 205.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 265.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=267.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003745318352059925, (0, 1): 0.9925093632958801, (0, 2): 0.003745318352059925}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.003745318352059925, (0, 1): 0.9925093632958801, (0, 2): 0.003745318352059925}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 265.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=270.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9814814814814815, (1, 1): 0.003703703703703704, (1, 2): 0.014814814814814815}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9814814814814815, (1, 1): 0.003703703703703704, (1, 2): 0.014814814814814815}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 265.0 -> 266.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 265.0 -> 266.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 215.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=221.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9728506787330317, (1, 1): 0.00904977375565611, (1, 2): 0.01809954751131222}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9728506787330317, (1, 1): 0.00904977375565611, (1, 2): 0.01809954751131222}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 215.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=226.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008849557522123894, (0, 1): 0.9513274336283186, (0, 2): 0.03982300884955752}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008849557522123894, (0, 1): 0.9513274336283186, (0, 2): 0.03982300884955752}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 215.0 -> 216.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 215.0 -> 216.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 309.0}
in get_filtered_urn(filter=1) --- total: total=311.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003215434083601286, (1, 1): 0.003215434083601286, (1, 2): 0.9935691318327974}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003215434083601286, (1, 1): 0.003215434083601286, (1, 2): 0.9935691318327974}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 309.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=311.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003215434083601286, (2, 1): 0.9935691318327974, (2, 2): 0.003215434083601286}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003215434083601286, (2, 1): 0.9935691318327974, (2, 2): 0.003215434083601286}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 309.0 -> 310.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 309.0 -> 310.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 225.0}
in get_filtered_urn(filter=0) --- total: total=237.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008438818565400843, (0, 1): 0.04219409282700422, (0, 2): 0.9493670886075949}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008438818565400843, (0, 1): 0.04219409282700422, (0, 2): 0.9493670886075949}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 225.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=231.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.974025974025974, (2, 1): 0.017316017316017316, (2, 2): 0.008658008658008658}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.974025974025974, (2, 1): 0.017316017316017316, (2, 2): 0.008658008658008658}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 225.0 -> 226.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 225.0 -> 226.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 266.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=268.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0037313432835820895, (0, 1): 0.9925373134328358, (0, 2): 0.0037313432835820895}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0037313432835820895, (0, 1): 0.9925373134328358, (0, 2): 0.0037313432835820895}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 266.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=271.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.981549815498155, (1, 1): 0.0036900369003690036, (1, 2): 0.014760147601476014}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.981549815498155, (1, 1): 0.0036900369003690036, (1, 2): 0.014760147601476014}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 266.0 -> 267.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 266.0 -> 267.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 216.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=222.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.972972972972973, (1, 1): 0.009009009009009009, (1, 2): 0.018018018018018018}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.972972972972973, (1, 1): 0.009009009009009009, (1, 2): 0.018018018018018018}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 216.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=227.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00881057268722467, (0, 1): 0.9515418502202643, (0, 2): 0.039647577092511016}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00881057268722467, (0, 1): 0.9515418502202643, (0, 2): 0.039647577092511016}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 216.0 -> 217.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 216.0 -> 217.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 310.0}
in get_filtered_urn(filter=1) --- total: total=312.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003205128205128205, (1, 1): 0.003205128205128205, (1, 2): 0.9935897435897436}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003205128205128205, (1, 1): 0.003205128205128205, (1, 2): 0.9935897435897436}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 310.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=312.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003205128205128205, (2, 1): 0.9935897435897436, (2, 2): 0.003205128205128205}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003205128205128205, (2, 1): 0.9935897435897436, (2, 2): 0.003205128205128205}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 310.0 -> 311.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 310.0 -> 311.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 217.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=223.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9730941704035875, (1, 1): 0.008968609865470852, (1, 2): 0.017937219730941704}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9730941704035875, (1, 1): 0.008968609865470852, (1, 2): 0.017937219730941704}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 217.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=228.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008771929824561403, (0, 1): 0.9517543859649122, (0, 2): 0.039473684210526314}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008771929824561403, (0, 1): 0.9517543859649122, (0, 2): 0.039473684210526314}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 217.0 -> 218.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 217.0 -> 218.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 267.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=269.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0037174721189591076, (0, 1): 0.9925650557620818, (0, 2): 0.0037174721189591076}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0037174721189591076, (0, 1): 0.9925650557620818, (0, 2): 0.0037174721189591076}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 267.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=272.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9816176470588235, (1, 1): 0.003676470588235294, (1, 2): 0.014705882352941176}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9816176470588235, (1, 1): 0.003676470588235294, (1, 2): 0.014705882352941176}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 267.0 -> 268.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 267.0 -> 268.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 205.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=216.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.041666666666666664, (2, 1): 0.9490740740740741, (2, 2): 0.009259259259259259}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.041666666666666664, (2, 1): 0.9490740740740741, (2, 2): 0.009259259259259259}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 205.0}
in get_filtered_urn(filter=1) --- total: total=217.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04608294930875576, (1, 1): 0.009216589861751152, (1, 2): 0.9447004608294931}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04608294930875576, (1, 1): 0.009216589861751152, (1, 2): 0.9447004608294931}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 205.0 -> 206.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 205.0 -> 206.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 268.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=270.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003703703703703704, (0, 1): 0.9925925925925926, (0, 2): 0.003703703703703704}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.003703703703703704, (0, 1): 0.9925925925925926, (0, 2): 0.003703703703703704}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 268.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=273.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9816849816849816, (1, 1): 0.003663003663003663, (1, 2): 0.014652014652014652}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9816849816849816, (1, 1): 0.003663003663003663, (1, 2): 0.014652014652014652}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 268.0 -> 269.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 268.0 -> 269.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 206.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=217.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.041474654377880185, (2, 1): 0.9493087557603687, (2, 2): 0.009216589861751152}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.041474654377880185, (2, 1): 0.9493087557603687, (2, 2): 0.009216589861751152}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 206.0}
in get_filtered_urn(filter=1) --- total: total=218.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.045871559633027525, (1, 1): 0.009174311926605505, (1, 2): 0.944954128440367}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.045871559633027525, (1, 1): 0.009174311926605505, (1, 2): 0.944954128440367}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 206.0 -> 207.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 206.0 -> 207.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 311.0}
in get_filtered_urn(filter=1) --- total: total=313.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003194888178913738, (1, 1): 0.003194888178913738, (1, 2): 0.9936102236421726}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003194888178913738, (1, 1): 0.003194888178913738, (1, 2): 0.9936102236421726}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 311.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=313.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003194888178913738, (2, 1): 0.9936102236421726, (2, 2): 0.003194888178913738}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003194888178913738, (2, 1): 0.9936102236421726, (2, 2): 0.003194888178913738}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 311.0 -> 312.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 311.0 -> 312.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 226.0}
in get_filtered_urn(filter=0) --- total: total=238.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008403361344537815, (0, 1): 0.04201680672268908, (0, 2): 0.9495798319327731}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008403361344537815, (0, 1): 0.04201680672268908, (0, 2): 0.9495798319327731}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 226.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=232.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9741379310344828, (2, 1): 0.017241379310344827, (2, 2): 0.008620689655172414}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9741379310344828, (2, 1): 0.017241379310344827, (2, 2): 0.008620689655172414}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 226.0 -> 227.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 226.0 -> 227.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 245.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=250.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.98, (2, 1): 0.016, (2, 2): 0.004}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.98, (2, 1): 0.016, (2, 2): 0.004}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 245.0}
in get_filtered_urn(filter=0) --- total: total=247.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004048582995951417, (0, 1): 0.004048582995951417, (0, 2): 0.9919028340080972}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004048582995951417, (0, 1): 0.004048582995951417, (0, 2): 0.9919028340080972}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 245.0 -> 246.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 245.0 -> 246.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 227.0}
in get_filtered_urn(filter=0) --- total: total=239.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008368200836820083, (0, 1): 0.04184100418410042, (0, 2): 0.9497907949790795}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008368200836820083, (0, 1): 0.04184100418410042, (0, 2): 0.9497907949790795}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 227.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=233.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9742489270386266, (2, 1): 0.017167381974248927, (2, 2): 0.008583690987124463}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9742489270386266, (2, 1): 0.017167381974248927, (2, 2): 0.008583690987124463}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 227.0 -> 228.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 227.0 -> 228.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 246.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=251.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9800796812749004, (2, 1): 0.01593625498007968, (2, 2): 0.00398406374501992}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9800796812749004, (2, 1): 0.01593625498007968, (2, 2): 0.00398406374501992}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 246.0}
in get_filtered_urn(filter=0) --- total: total=248.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004032258064516129, (0, 1): 0.004032258064516129, (0, 2): 0.9919354838709677}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004032258064516129, (0, 1): 0.004032258064516129, (0, 2): 0.9919354838709677}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 246.0 -> 247.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 246.0 -> 247.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 207.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=218.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04128440366972477, (2, 1): 0.9495412844036697, (2, 2): 0.009174311926605505}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04128440366972477, (2, 1): 0.9495412844036697, (2, 2): 0.009174311926605505}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 207.0}
in get_filtered_urn(filter=1) --- total: total=219.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.045662100456621, (1, 1): 0.0091324200913242, (1, 2): 0.9452054794520548}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.045662100456621, (1, 1): 0.0091324200913242, (1, 2): 0.9452054794520548}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 207.0 -> 208.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 207.0 -> 208.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 247.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=252.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9801587301587301, (2, 1): 0.015873015873015872, (2, 2): 0.003968253968253968}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9801587301587301, (2, 1): 0.015873015873015872, (2, 2): 0.003968253968253968}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 247.0}
in get_filtered_urn(filter=0) --- total: total=249.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004016064257028112, (0, 1): 0.004016064257028112, (0, 2): 0.9919678714859438}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004016064257028112, (0, 1): 0.004016064257028112, (0, 2): 0.9919678714859438}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 247.0 -> 248.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 247.0 -> 248.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 208.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=219.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0410958904109589, (2, 1): 0.9497716894977168, (2, 2): 0.0091324200913242}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0410958904109589, (2, 1): 0.9497716894977168, (2, 2): 0.0091324200913242}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 208.0}
in get_filtered_urn(filter=1) --- total: total=220.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.045454545454545456, (1, 1): 0.00909090909090909, (1, 2): 0.9454545454545454}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.045454545454545456, (1, 1): 0.00909090909090909, (1, 2): 0.9454545454545454}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 208.0 -> 209.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 208.0 -> 209.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 248.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=253.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9802371541501976, (2, 1): 0.015810276679841896, (2, 2): 0.003952569169960474}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9802371541501976, (2, 1): 0.015810276679841896, (2, 2): 0.003952569169960474}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 248.0}
in get_filtered_urn(filter=0) --- total: total=250.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.004, (0, 1): 0.004, (0, 2): 0.992}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.004, (0, 1): 0.004, (0, 2): 0.992}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 248.0 -> 249.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 248.0 -> 249.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 209.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=220.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04090909090909091, (2, 1): 0.95, (2, 2): 0.00909090909090909}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04090909090909091, (2, 1): 0.95, (2, 2): 0.00909090909090909}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 209.0}
in get_filtered_urn(filter=1) --- total: total=221.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04524886877828054, (1, 1): 0.00904977375565611, (1, 2): 0.9457013574660633}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04524886877828054, (1, 1): 0.00904977375565611, (1, 2): 0.9457013574660633}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 209.0 -> 210.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 209.0 -> 210.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 249.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=254.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9803149606299213, (2, 1): 0.015748031496062992, (2, 2): 0.003937007874015748}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9803149606299213, (2, 1): 0.015748031496062992, (2, 2): 0.003937007874015748}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 249.0}
in get_filtered_urn(filter=0) --- total: total=251.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00398406374501992, (0, 1): 0.00398406374501992, (0, 2): 0.9920318725099602}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00398406374501992, (0, 1): 0.00398406374501992, (0, 2): 0.9920318725099602}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 249.0 -> 250.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 249.0 -> 250.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 218.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=224.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9732142857142857, (1, 1): 0.008928571428571428, (1, 2): 0.017857142857142856}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9732142857142857, (1, 1): 0.008928571428571428, (1, 2): 0.017857142857142856}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 218.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=229.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008733624454148471, (0, 1): 0.9519650655021834, (0, 2): 0.039301310043668124}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008733624454148471, (0, 1): 0.9519650655021834, (0, 2): 0.039301310043668124}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 218.0 -> 219.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 218.0 -> 219.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 269.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=271.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0036900369003690036, (0, 1): 0.992619926199262, (0, 2): 0.0036900369003690036}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0036900369003690036, (0, 1): 0.992619926199262, (0, 2): 0.0036900369003690036}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 269.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=274.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9817518248175182, (1, 1): 0.0036496350364963502, (1, 2): 0.014598540145985401}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9817518248175182, (1, 1): 0.0036496350364963502, (1, 2): 0.014598540145985401}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 269.0 -> 270.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 269.0 -> 270.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 228.0}
in get_filtered_urn(filter=0) --- total: total=240.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008333333333333333, (0, 1): 0.041666666666666664, (0, 2): 0.95}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008333333333333333, (0, 1): 0.041666666666666664, (0, 2): 0.95}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 228.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=234.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9743589743589743, (2, 1): 0.017094017094017096, (2, 2): 0.008547008547008548}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9743589743589743, (2, 1): 0.017094017094017096, (2, 2): 0.008547008547008548}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 228.0 -> 229.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 228.0 -> 229.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 270.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=272.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003676470588235294, (0, 1): 0.9926470588235294, (0, 2): 0.003676470588235294}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.003676470588235294, (0, 1): 0.9926470588235294, (0, 2): 0.003676470588235294}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 270.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=275.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9818181818181818, (1, 1): 0.0036363636363636364, (1, 2): 0.014545454545454545}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9818181818181818, (1, 1): 0.0036363636363636364, (1, 2): 0.014545454545454545}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 270.0 -> 271.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 270.0 -> 271.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 229.0}
in get_filtered_urn(filter=0) --- total: total=241.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008298755186721992, (0, 1): 0.04149377593360996, (0, 2): 0.950207468879668}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008298755186721992, (0, 1): 0.04149377593360996, (0, 2): 0.950207468879668}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 229.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=235.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9744680851063829, (2, 1): 0.01702127659574468, (2, 2): 0.00851063829787234}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9744680851063829, (2, 1): 0.01702127659574468, (2, 2): 0.00851063829787234}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 229.0 -> 230.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 229.0 -> 230.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 312.0}
in get_filtered_urn(filter=1) --- total: total=314.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0031847133757961785, (1, 1): 0.0031847133757961785, (1, 2): 0.9936305732484076}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0031847133757961785, (1, 1): 0.0031847133757961785, (1, 2): 0.9936305732484076}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 312.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=314.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0031847133757961785, (2, 1): 0.9936305732484076, (2, 2): 0.0031847133757961785}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0031847133757961785, (2, 1): 0.9936305732484076, (2, 2): 0.0031847133757961785}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 312.0 -> 313.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 312.0 -> 313.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 210.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=221.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04072398190045249, (2, 1): 0.9502262443438914, (2, 2): 0.00904977375565611}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04072398190045249, (2, 1): 0.9502262443438914, (2, 2): 0.00904977375565611}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 210.0}
in get_filtered_urn(filter=1) --- total: total=222.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04504504504504504, (1, 1): 0.009009009009009009, (1, 2): 0.9459459459459459}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04504504504504504, (1, 1): 0.009009009009009009, (1, 2): 0.9459459459459459}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 210.0 -> 211.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 210.0 -> 211.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 313.0}
in get_filtered_urn(filter=1) --- total: total=315.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0031746031746031746, (1, 1): 0.0031746031746031746, (1, 2): 0.9936507936507937}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0031746031746031746, (1, 1): 0.0031746031746031746, (1, 2): 0.9936507936507937}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 313.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=315.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0031746031746031746, (2, 1): 0.9936507936507937, (2, 2): 0.0031746031746031746}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0031746031746031746, (2, 1): 0.9936507936507937, (2, 2): 0.0031746031746031746}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 313.0 -> 314.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 313.0 -> 314.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 219.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=225.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9733333333333334, (1, 1): 0.008888888888888889, (1, 2): 0.017777777777777778}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9733333333333334, (1, 1): 0.008888888888888889, (1, 2): 0.017777777777777778}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 219.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=230.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008695652173913044, (0, 1): 0.9521739130434783, (0, 2): 0.0391304347826087}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008695652173913044, (0, 1): 0.9521739130434783, (0, 2): 0.0391304347826087}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 219.0 -> 220.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 219.0 -> 220.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 271.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=273.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003663003663003663, (0, 1): 0.9926739926739927, (0, 2): 0.003663003663003663}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.003663003663003663, (0, 1): 0.9926739926739927, (0, 2): 0.003663003663003663}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 271.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=276.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9818840579710145, (1, 1): 0.0036231884057971015, (1, 2): 0.014492753623188406}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9818840579710145, (1, 1): 0.0036231884057971015, (1, 2): 0.014492753623188406}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 271.0 -> 272.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 271.0 -> 272.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 230.0}
in get_filtered_urn(filter=0) --- total: total=242.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008264462809917356, (0, 1): 0.04132231404958678, (0, 2): 0.9504132231404959}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008264462809917356, (0, 1): 0.04132231404958678, (0, 2): 0.9504132231404959}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 230.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=236.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9745762711864406, (2, 1): 0.01694915254237288, (2, 2): 0.00847457627118644}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9745762711864406, (2, 1): 0.01694915254237288, (2, 2): 0.00847457627118644}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 230.0 -> 231.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 230.0 -> 231.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 272.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=274.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0036496350364963502, (0, 1): 0.9927007299270073, (0, 2): 0.0036496350364963502}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0036496350364963502, (0, 1): 0.9927007299270073, (0, 2): 0.0036496350364963502}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 272.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=277.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9819494584837545, (1, 1): 0.0036101083032490976, (1, 2): 0.01444043321299639}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9819494584837545, (1, 1): 0.0036101083032490976, (1, 2): 0.01444043321299639}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 272.0 -> 273.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 272.0 -> 273.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 211.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=222.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04054054054054054, (2, 1): 0.9504504504504504, (2, 2): 0.009009009009009009}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04054054054054054, (2, 1): 0.9504504504504504, (2, 2): 0.009009009009009009}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 211.0}
in get_filtered_urn(filter=1) --- total: total=223.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04484304932735426, (1, 1): 0.008968609865470852, (1, 2): 0.9461883408071748}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04484304932735426, (1, 1): 0.008968609865470852, (1, 2): 0.9461883408071748}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 211.0 -> 212.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 211.0 -> 212.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 273.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=275.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0036363636363636364, (0, 1): 0.9927272727272727, (0, 2): 0.0036363636363636364}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0036363636363636364, (0, 1): 0.9927272727272727, (0, 2): 0.0036363636363636364}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 273.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=278.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9820143884892086, (1, 1): 0.0035971223021582736, (1, 2): 0.014388489208633094}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9820143884892086, (1, 1): 0.0035971223021582736, (1, 2): 0.014388489208633094}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 273.0 -> 274.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 273.0 -> 274.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 212.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=223.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04035874439461883, (2, 1): 0.9506726457399103, (2, 2): 0.008968609865470852}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04035874439461883, (2, 1): 0.9506726457399103, (2, 2): 0.008968609865470852}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 212.0}
in get_filtered_urn(filter=1) --- total: total=224.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.044642857142857144, (1, 1): 0.008928571428571428, (1, 2): 0.9464285714285714}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.044642857142857144, (1, 1): 0.008928571428571428, (1, 2): 0.9464285714285714}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 212.0 -> 213.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 212.0 -> 213.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 274.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=276.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0036231884057971015, (0, 1): 0.9927536231884058, (0, 2): 0.0036231884057971015}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0036231884057971015, (0, 1): 0.9927536231884058, (0, 2): 0.0036231884057971015}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 274.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=279.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.982078853046595, (1, 1): 0.0035842293906810036, (1, 2): 0.014336917562724014}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.982078853046595, (1, 1): 0.0035842293906810036, (1, 2): 0.014336917562724014}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 274.0 -> 275.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 274.0 -> 275.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 231.0}
in get_filtered_urn(filter=0) --- total: total=243.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00823045267489712, (0, 1): 0.0411522633744856, (0, 2): 0.9506172839506173}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00823045267489712, (0, 1): 0.0411522633744856, (0, 2): 0.9506172839506173}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 231.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=237.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9746835443037974, (2, 1): 0.016877637130801686, (2, 2): 0.008438818565400843}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9746835443037974, (2, 1): 0.016877637130801686, (2, 2): 0.008438818565400843}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 231.0 -> 232.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 231.0 -> 232.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 275.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=277.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0036101083032490976, (0, 1): 0.9927797833935018, (0, 2): 0.0036101083032490976}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0036101083032490976, (0, 1): 0.9927797833935018, (0, 2): 0.0036101083032490976}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 275.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=280.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9821428571428571, (1, 1): 0.0035714285714285713, (1, 2): 0.014285714285714285}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9821428571428571, (1, 1): 0.0035714285714285713, (1, 2): 0.014285714285714285}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 275.0 -> 276.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 275.0 -> 276.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 220.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=226.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9734513274336283, (1, 1): 0.008849557522123894, (1, 2): 0.017699115044247787}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9734513274336283, (1, 1): 0.008849557522123894, (1, 2): 0.017699115044247787}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 220.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=231.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008658008658008658, (0, 1): 0.9523809523809523, (0, 2): 0.03896103896103896}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008658008658008658, (0, 1): 0.9523809523809523, (0, 2): 0.03896103896103896}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 220.0 -> 221.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 220.0 -> 221.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 314.0}
in get_filtered_urn(filter=1) --- total: total=316.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0031645569620253164, (1, 1): 0.0031645569620253164, (1, 2): 0.9936708860759493}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0031645569620253164, (1, 1): 0.0031645569620253164, (1, 2): 0.9936708860759493}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 314.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=316.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0031645569620253164, (2, 1): 0.9936708860759493, (2, 2): 0.0031645569620253164}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0031645569620253164, (2, 1): 0.9936708860759493, (2, 2): 0.0031645569620253164}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 314.0 -> 315.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 314.0 -> 315.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 213.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=224.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04017857142857143, (2, 1): 0.9508928571428571, (2, 2): 0.008928571428571428}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04017857142857143, (2, 1): 0.9508928571428571, (2, 2): 0.008928571428571428}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 213.0}
in get_filtered_urn(filter=1) --- total: total=225.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.044444444444444446, (1, 1): 0.008888888888888889, (1, 2): 0.9466666666666667}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.044444444444444446, (1, 1): 0.008888888888888889, (1, 2): 0.9466666666666667}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 213.0 -> 214.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 213.0 -> 214.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 276.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=278.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0035971223021582736, (0, 1): 0.9928057553956835, (0, 2): 0.0035971223021582736}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0035971223021582736, (0, 1): 0.9928057553956835, (0, 2): 0.0035971223021582736}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 276.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=281.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9822064056939501, (1, 1): 0.0035587188612099642, (1, 2): 0.014234875444839857}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9822064056939501, (1, 1): 0.0035587188612099642, (1, 2): 0.014234875444839857}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 276.0 -> 277.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 276.0 -> 277.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 232.0}
in get_filtered_urn(filter=0) --- total: total=244.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00819672131147541, (0, 1): 0.040983606557377046, (0, 2): 0.9508196721311475}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00819672131147541, (0, 1): 0.040983606557377046, (0, 2): 0.9508196721311475}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 232.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=238.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9747899159663865, (2, 1): 0.01680672268907563, (2, 2): 0.008403361344537815}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9747899159663865, (2, 1): 0.01680672268907563, (2, 2): 0.008403361344537815}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 232.0 -> 233.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 232.0 -> 233.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 277.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=279.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0035842293906810036, (0, 1): 0.992831541218638, (0, 2): 0.0035842293906810036}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0035842293906810036, (0, 1): 0.992831541218638, (0, 2): 0.0035842293906810036}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 277.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=282.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9822695035460993, (1, 1): 0.0035460992907801418, (1, 2): 0.014184397163120567}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9822695035460993, (1, 1): 0.0035460992907801418, (1, 2): 0.014184397163120567}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 277.0 -> 278.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 277.0 -> 278.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 221.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=227.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.973568281938326, (1, 1): 0.00881057268722467, (1, 2): 0.01762114537444934}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.973568281938326, (1, 1): 0.00881057268722467, (1, 2): 0.01762114537444934}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 221.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=232.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008620689655172414, (0, 1): 0.9525862068965517, (0, 2): 0.03879310344827586}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008620689655172414, (0, 1): 0.9525862068965517, (0, 2): 0.03879310344827586}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 221.0 -> 222.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 221.0 -> 222.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 315.0}
in get_filtered_urn(filter=1) --- total: total=317.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0031545741324921135, (1, 1): 0.0031545741324921135, (1, 2): 0.9936908517350158}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0031545741324921135, (1, 1): 0.0031545741324921135, (1, 2): 0.9936908517350158}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 315.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=317.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0031545741324921135, (2, 1): 0.9936908517350158, (2, 2): 0.0031545741324921135}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0031545741324921135, (2, 1): 0.9936908517350158, (2, 2): 0.0031545741324921135}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 315.0 -> 316.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 315.0 -> 316.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 214.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=225.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.04, (2, 1): 0.9511111111111111, (2, 2): 0.008888888888888889}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.04, (2, 1): 0.9511111111111111, (2, 2): 0.008888888888888889}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 214.0}
in get_filtered_urn(filter=1) --- total: total=226.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04424778761061947, (1, 1): 0.008849557522123894, (1, 2): 0.9469026548672567}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04424778761061947, (1, 1): 0.008849557522123894, (1, 2): 0.9469026548672567}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 214.0 -> 215.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 214.0 -> 215.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 278.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=280.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0035714285714285713, (0, 1): 0.9928571428571429, (0, 2): 0.0035714285714285713}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0035714285714285713, (0, 1): 0.9928571428571429, (0, 2): 0.0035714285714285713}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 278.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=283.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9823321554770318, (1, 1): 0.0035335689045936395, (1, 2): 0.014134275618374558}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9823321554770318, (1, 1): 0.0035335689045936395, (1, 2): 0.014134275618374558}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 278.0 -> 279.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 278.0 -> 279.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 222.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=228.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9736842105263158, (1, 1): 0.008771929824561403, (1, 2): 0.017543859649122806}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9736842105263158, (1, 1): 0.008771929824561403, (1, 2): 0.017543859649122806}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 222.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=233.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008583690987124463, (0, 1): 0.9527896995708155, (0, 2): 0.03862660944206009}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008583690987124463, (0, 1): 0.9527896995708155, (0, 2): 0.03862660944206009}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 222.0 -> 223.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 222.0 -> 223.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 279.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=281.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0035587188612099642, (0, 1): 0.9928825622775801, (0, 2): 0.0035587188612099642}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0035587188612099642, (0, 1): 0.9928825622775801, (0, 2): 0.0035587188612099642}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 279.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=284.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9823943661971831, (1, 1): 0.0035211267605633804, (1, 2): 0.014084507042253521}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9823943661971831, (1, 1): 0.0035211267605633804, (1, 2): 0.014084507042253521}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 279.0 -> 280.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 279.0 -> 280.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 215.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=226.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.03982300884955752, (2, 1): 0.9513274336283186, (2, 2): 0.008849557522123894}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.03982300884955752, (2, 1): 0.9513274336283186, (2, 2): 0.008849557522123894}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 215.0}
in get_filtered_urn(filter=1) --- total: total=227.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04405286343612335, (1, 1): 0.00881057268722467, (1, 2): 0.947136563876652}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04405286343612335, (1, 1): 0.00881057268722467, (1, 2): 0.947136563876652}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 215.0 -> 216.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 215.0 -> 216.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 316.0}
in get_filtered_urn(filter=1) --- total: total=318.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0031446540880503146, (1, 1): 0.0031446540880503146, (1, 2): 0.9937106918238994}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0031446540880503146, (1, 1): 0.0031446540880503146, (1, 2): 0.9937106918238994}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 316.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=318.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0031446540880503146, (2, 1): 0.9937106918238994, (2, 2): 0.0031446540880503146}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0031446540880503146, (2, 1): 0.9937106918238994, (2, 2): 0.0031446540880503146}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 316.0 -> 317.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 316.0 -> 317.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 233.0}
in get_filtered_urn(filter=0) --- total: total=245.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00816326530612245, (0, 1): 0.04081632653061224, (0, 2): 0.9510204081632653}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00816326530612245, (0, 1): 0.04081632653061224, (0, 2): 0.9510204081632653}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 233.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=239.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9748953974895398, (2, 1): 0.016736401673640166, (2, 2): 0.008368200836820083}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9748953974895398, (2, 1): 0.016736401673640166, (2, 2): 0.008368200836820083}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 233.0 -> 234.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 233.0 -> 234.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 280.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=282.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0035460992907801418, (0, 1): 0.9929078014184397, (0, 2): 0.0035460992907801418}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0035460992907801418, (0, 1): 0.9929078014184397, (0, 2): 0.0035460992907801418}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 280.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=285.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9824561403508771, (1, 1): 0.0035087719298245615, (1, 2): 0.014035087719298246}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9824561403508771, (1, 1): 0.0035087719298245615, (1, 2): 0.014035087719298246}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 280.0 -> 281.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 280.0 -> 281.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 223.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=229.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9737991266375546, (1, 1): 0.008733624454148471, (1, 2): 0.017467248908296942}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9737991266375546, (1, 1): 0.008733624454148471, (1, 2): 0.017467248908296942}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 223.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=234.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008547008547008548, (0, 1): 0.9529914529914529, (0, 2): 0.038461538461538464}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008547008547008548, (0, 1): 0.9529914529914529, (0, 2): 0.038461538461538464}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 223.0 -> 224.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 223.0 -> 224.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 250.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=255.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9803921568627451, (2, 1): 0.01568627450980392, (2, 2): 0.00392156862745098}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9803921568627451, (2, 1): 0.01568627450980392, (2, 2): 0.00392156862745098}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 250.0}
in get_filtered_urn(filter=0) --- total: total=252.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003968253968253968, (0, 1): 0.003968253968253968, (0, 2): 0.9920634920634921}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.003968253968253968, (0, 1): 0.003968253968253968, (0, 2): 0.9920634920634921}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 250.0 -> 251.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 250.0 -> 251.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 224.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=230.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9739130434782609, (1, 1): 0.008695652173913044, (1, 2): 0.017391304347826087}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 1) from urn={(1, 0): 0.9739130434782609, (1, 1): 0.008695652173913044, (1, 2): 0.017391304347826087}
Sender 4 got filter 1 choose option: (1, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 216.0}
in get_filtered_urn(filter=1) --- total: total=228.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.043859649122807015, (1, 1): 0.008771929824561403, (1, 2): 0.9473684210526315}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.043859649122807015, (1, 1): 0.008771929824561403, (1, 2): 0.9473684210526315}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (1, 1): 2.0 -> 2.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 216.0 -> 216.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 251.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=256.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.98046875, (2, 1): 0.015625, (2, 2): 0.00390625}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.98046875, (2, 1): 0.015625, (2, 2): 0.00390625}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 251.0}
in get_filtered_urn(filter=0) --- total: total=253.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003952569169960474, (0, 1): 0.003952569169960474, (0, 2): 0.9920948616600791}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.003952569169960474, (0, 1): 0.003952569169960474, (0, 2): 0.9920948616600791}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 251.0 -> 252.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 251.0 -> 252.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 224.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=230.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9739130434782609, (1, 1): 0.008695652173913044, (1, 2): 0.017391304347826087}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9739130434782609, (1, 1): 0.008695652173913044, (1, 2): 0.017391304347826087}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 224.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=235.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00851063829787234, (0, 1): 0.9531914893617022, (0, 2): 0.03829787234042553}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00851063829787234, (0, 1): 0.9531914893617022, (0, 2): 0.03829787234042553}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 224.0 -> 225.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 224.0 -> 225.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 317.0}
in get_filtered_urn(filter=1) --- total: total=319.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003134796238244514, (1, 1): 0.003134796238244514, (1, 2): 0.9937304075235109}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003134796238244514, (1, 1): 0.003134796238244514, (1, 2): 0.9937304075235109}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 317.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=319.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003134796238244514, (2, 1): 0.9937304075235109, (2, 2): 0.003134796238244514}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003134796238244514, (2, 1): 0.9937304075235109, (2, 2): 0.003134796238244514}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 317.0 -> 318.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 317.0 -> 318.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 234.0}
in get_filtered_urn(filter=0) --- total: total=246.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008130081300813009, (0, 1): 0.04065040650406504, (0, 2): 0.9512195121951219}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008130081300813009, (0, 1): 0.04065040650406504, (0, 2): 0.9512195121951219}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 234.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=240.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.975, (2, 1): 0.016666666666666666, (2, 2): 0.008333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.975, (2, 1): 0.016666666666666666, (2, 2): 0.008333333333333333}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 234.0 -> 235.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 234.0 -> 235.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 318.0}
in get_filtered_urn(filter=1) --- total: total=320.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003125, (1, 1): 0.003125, (1, 2): 0.99375}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003125, (1, 1): 0.003125, (1, 2): 0.99375}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 318.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=320.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003125, (2, 1): 0.99375, (2, 2): 0.003125}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003125, (2, 1): 0.99375, (2, 2): 0.003125}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 318.0 -> 319.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 318.0 -> 319.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 216.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=227.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.039647577092511016, (2, 1): 0.9515418502202643, (2, 2): 0.00881057268722467}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.039647577092511016, (2, 1): 0.9515418502202643, (2, 2): 0.00881057268722467}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 216.0}
in get_filtered_urn(filter=1) --- total: total=228.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.043859649122807015, (1, 1): 0.008771929824561403, (1, 2): 0.9473684210526315}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.043859649122807015, (1, 1): 0.008771929824561403, (1, 2): 0.9473684210526315}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 216.0 -> 217.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 216.0 -> 217.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 281.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=283.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0035335689045936395, (0, 1): 0.9929328621908127, (0, 2): 0.0035335689045936395}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0035335689045936395, (0, 1): 0.9929328621908127, (0, 2): 0.0035335689045936395}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 281.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=286.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9825174825174825, (1, 1): 0.0034965034965034965, (1, 2): 0.013986013986013986}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9825174825174825, (1, 1): 0.0034965034965034965, (1, 2): 0.013986013986013986}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 281.0 -> 282.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 281.0 -> 282.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 235.0}
in get_filtered_urn(filter=0) --- total: total=247.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008097165991902834, (0, 1): 0.04048582995951417, (0, 2): 0.951417004048583}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008097165991902834, (0, 1): 0.04048582995951417, (0, 2): 0.951417004048583}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 235.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=241.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.975103734439834, (2, 1): 0.016597510373443983, (2, 2): 0.008298755186721992}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.975103734439834, (2, 1): 0.016597510373443983, (2, 2): 0.008298755186721992}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 235.0 -> 236.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 235.0 -> 236.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 252.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=257.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.980544747081712, (2, 1): 0.01556420233463035, (2, 2): 0.0038910505836575876}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.980544747081712, (2, 1): 0.01556420233463035, (2, 2): 0.0038910505836575876}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 252.0}
in get_filtered_urn(filter=0) --- total: total=254.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003937007874015748, (0, 1): 0.003937007874015748, (0, 2): 0.9921259842519685}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.003937007874015748, (0, 1): 0.003937007874015748, (0, 2): 0.9921259842519685}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 252.0 -> 253.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 252.0 -> 253.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 225.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=231.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.974025974025974, (1, 1): 0.008658008658008658, (1, 2): 0.017316017316017316}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.974025974025974, (1, 1): 0.008658008658008658, (1, 2): 0.017316017316017316}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 225.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=236.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00847457627118644, (0, 1): 0.9533898305084746, (0, 2): 0.038135593220338986}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00847457627118644, (0, 1): 0.9533898305084746, (0, 2): 0.038135593220338986}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 225.0 -> 226.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 225.0 -> 226.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 319.0}
in get_filtered_urn(filter=1) --- total: total=321.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003115264797507788, (1, 1): 0.003115264797507788, (1, 2): 0.9937694704049844}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003115264797507788, (1, 1): 0.003115264797507788, (1, 2): 0.9937694704049844}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 319.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=321.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003115264797507788, (2, 1): 0.9937694704049844, (2, 2): 0.003115264797507788}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003115264797507788, (2, 1): 0.9937694704049844, (2, 2): 0.003115264797507788}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 319.0 -> 320.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 319.0 -> 320.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 226.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=232.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9741379310344828, (1, 1): 0.008620689655172414, (1, 2): 0.017241379310344827}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9741379310344828, (1, 1): 0.008620689655172414, (1, 2): 0.017241379310344827}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 226.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=237.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008438818565400843, (0, 1): 0.9535864978902954, (0, 2): 0.0379746835443038}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008438818565400843, (0, 1): 0.9535864978902954, (0, 2): 0.0379746835443038}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 226.0 -> 227.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 226.0 -> 227.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 320.0}
in get_filtered_urn(filter=1) --- total: total=322.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003105590062111801, (1, 1): 0.003105590062111801, (1, 2): 0.9937888198757764}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003105590062111801, (1, 1): 0.003105590062111801, (1, 2): 0.9937888198757764}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 320.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=322.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003105590062111801, (2, 1): 0.9937888198757764, (2, 2): 0.003105590062111801}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003105590062111801, (2, 1): 0.9937888198757764, (2, 2): 0.003105590062111801}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 320.0 -> 321.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 320.0 -> 321.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 217.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=228.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.039473684210526314, (2, 1): 0.9517543859649122, (2, 2): 0.008771929824561403}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.039473684210526314, (2, 1): 0.9517543859649122, (2, 2): 0.008771929824561403}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 217.0}
in get_filtered_urn(filter=1) --- total: total=229.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.043668122270742356, (1, 1): 0.008733624454148471, (1, 2): 0.9475982532751092}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.043668122270742356, (1, 1): 0.008733624454148471, (1, 2): 0.9475982532751092}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 217.0 -> 218.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 217.0 -> 218.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 321.0}
in get_filtered_urn(filter=1) --- total: total=323.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0030959752321981426, (1, 1): 0.0030959752321981426, (1, 2): 0.9938080495356038}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0030959752321981426, (1, 1): 0.0030959752321981426, (1, 2): 0.9938080495356038}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 321.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=323.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0030959752321981426, (2, 1): 0.9938080495356038, (2, 2): 0.0030959752321981426}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0030959752321981426, (2, 1): 0.9938080495356038, (2, 2): 0.0030959752321981426}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 321.0 -> 322.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 321.0 -> 322.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 236.0}
in get_filtered_urn(filter=0) --- total: total=248.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008064516129032258, (0, 1): 0.04032258064516129, (0, 2): 0.9516129032258065}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008064516129032258, (0, 1): 0.04032258064516129, (0, 2): 0.9516129032258065}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 236.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=242.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9752066115702479, (2, 1): 0.01652892561983471, (2, 2): 0.008264462809917356}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9752066115702479, (2, 1): 0.01652892561983471, (2, 2): 0.008264462809917356}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 236.0 -> 237.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 236.0 -> 237.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 282.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=284.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0035211267605633804, (0, 1): 0.9929577464788732, (0, 2): 0.0035211267605633804}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0035211267605633804, (0, 1): 0.9929577464788732, (0, 2): 0.0035211267605633804}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 282.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=287.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9825783972125436, (1, 1): 0.003484320557491289, (1, 2): 0.013937282229965157}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9825783972125436, (1, 1): 0.003484320557491289, (1, 2): 0.013937282229965157}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 282.0 -> 283.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 282.0 -> 283.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 227.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=233.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9742489270386266, (1, 1): 0.008583690987124463, (1, 2): 0.017167381974248927}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9742489270386266, (1, 1): 0.008583690987124463, (1, 2): 0.017167381974248927}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 227.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=238.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008403361344537815, (0, 1): 0.9537815126050421, (0, 2): 0.037815126050420166}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008403361344537815, (0, 1): 0.9537815126050421, (0, 2): 0.037815126050420166}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 227.0 -> 228.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 227.0 -> 228.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 322.0}
in get_filtered_urn(filter=1) --- total: total=324.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0030864197530864196, (1, 1): 0.0030864197530864196, (1, 2): 0.9938271604938271}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0030864197530864196, (1, 1): 0.0030864197530864196, (1, 2): 0.9938271604938271}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 322.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=324.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0030864197530864196, (2, 1): 0.9938271604938271, (2, 2): 0.0030864197530864196}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0030864197530864196, (2, 1): 0.9938271604938271, (2, 2): 0.0030864197530864196}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 322.0 -> 323.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 322.0 -> 323.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 237.0}
in get_filtered_urn(filter=0) --- total: total=249.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008032128514056224, (0, 1): 0.040160642570281124, (0, 2): 0.9518072289156626}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008032128514056224, (0, 1): 0.040160642570281124, (0, 2): 0.9518072289156626}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 237.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=243.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9753086419753086, (2, 1): 0.01646090534979424, (2, 2): 0.00823045267489712}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9753086419753086, (2, 1): 0.01646090534979424, (2, 2): 0.00823045267489712}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 237.0 -> 238.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 237.0 -> 238.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 253.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=258.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9806201550387597, (2, 1): 0.015503875968992248, (2, 2): 0.003875968992248062}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9806201550387597, (2, 1): 0.015503875968992248, (2, 2): 0.003875968992248062}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 253.0}
in get_filtered_urn(filter=0) --- total: total=255.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00392156862745098, (0, 1): 0.00392156862745098, (0, 2): 0.9921568627450981}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00392156862745098, (0, 1): 0.00392156862745098, (0, 2): 0.9921568627450981}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 253.0 -> 254.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 253.0 -> 254.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 228.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=234.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9743589743589743, (1, 1): 0.008547008547008548, (1, 2): 0.017094017094017096}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9743589743589743, (1, 1): 0.008547008547008548, (1, 2): 0.017094017094017096}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 228.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=239.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008368200836820083, (0, 1): 0.9539748953974896, (0, 2): 0.03765690376569038}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008368200836820083, (0, 1): 0.9539748953974896, (0, 2): 0.03765690376569038}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 228.0 -> 229.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 228.0 -> 229.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 323.0}
in get_filtered_urn(filter=1) --- total: total=325.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003076923076923077, (1, 1): 0.003076923076923077, (1, 2): 0.9938461538461538}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003076923076923077, (1, 1): 0.003076923076923077, (1, 2): 0.9938461538461538}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 323.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=325.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003076923076923077, (2, 1): 0.9938461538461538, (2, 2): 0.003076923076923077}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003076923076923077, (2, 1): 0.9938461538461538, (2, 2): 0.003076923076923077}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 323.0 -> 324.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 323.0 -> 324.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 229.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=235.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9744680851063829, (1, 1): 0.00851063829787234, (1, 2): 0.01702127659574468}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9744680851063829, (1, 1): 0.00851063829787234, (1, 2): 0.01702127659574468}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 229.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=240.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008333333333333333, (0, 1): 0.9541666666666667, (0, 2): 0.0375}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008333333333333333, (0, 1): 0.9541666666666667, (0, 2): 0.0375}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 229.0 -> 230.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 229.0 -> 230.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 283.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=285.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0035087719298245615, (0, 1): 0.9929824561403509, (0, 2): 0.0035087719298245615}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0035087719298245615, (0, 1): 0.9929824561403509, (0, 2): 0.0035087719298245615}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 283.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=288.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9826388888888888, (1, 1): 0.003472222222222222, (1, 2): 0.013888888888888888}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.9826388888888888, (1, 1): 0.003472222222222222, (1, 2): 0.013888888888888888}
in decode_message(signal=1) Receiver 2 got option: (1, 2) and decoded action: 2
Receiver 2 received signals: [1] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (0, 1): 283.0 -> 283.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (1, 2): 4.0 -> 4.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 230.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=236.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9745762711864406, (1, 1): 0.00847457627118644, (1, 2): 0.01694915254237288}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9745762711864406, (1, 1): 0.00847457627118644, (1, 2): 0.01694915254237288}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 230.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=241.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008298755186721992, (0, 1): 0.9543568464730291, (0, 2): 0.03734439834024896}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008298755186721992, (0, 1): 0.9543568464730291, (0, 2): 0.03734439834024896}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 230.0 -> 231.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 230.0 -> 231.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 254.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=259.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9806949806949807, (2, 1): 0.015444015444015444, (2, 2): 0.003861003861003861}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9806949806949807, (2, 1): 0.015444015444015444, (2, 2): 0.003861003861003861}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 254.0}
in get_filtered_urn(filter=0) --- total: total=256.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00390625, (0, 1): 0.00390625, (0, 2): 0.9921875}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00390625, (0, 1): 0.00390625, (0, 2): 0.9921875}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 254.0 -> 255.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 254.0 -> 255.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 238.0}
in get_filtered_urn(filter=0) --- total: total=250.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008, (0, 1): 0.04, (0, 2): 0.952}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008, (0, 1): 0.04, (0, 2): 0.952}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 218.0}
in get_filtered_urn(filter=1) --- total: total=230.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.043478260869565216, (1, 1): 0.008695652173913044, (1, 2): 0.9478260869565217}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.043478260869565216, (1, 1): 0.008695652173913044, (1, 2): 0.9478260869565217}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 218.0 -> 218.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 283.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=285.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0035087719298245615, (0, 1): 0.9929824561403509, (0, 2): 0.0035087719298245615}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0035087719298245615, (0, 1): 0.9929824561403509, (0, 2): 0.0035087719298245615}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 283.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=288.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9826388888888888, (1, 1): 0.003472222222222222, (1, 2): 0.013888888888888888}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9826388888888888, (1, 1): 0.003472222222222222, (1, 2): 0.013888888888888888}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 283.0 -> 284.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 283.0 -> 284.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 231.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=237.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9746835443037974, (1, 1): 0.008438818565400843, (1, 2): 0.016877637130801686}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9746835443037974, (1, 1): 0.008438818565400843, (1, 2): 0.016877637130801686}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 231.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=242.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008264462809917356, (0, 1): 0.9545454545454546, (0, 2): 0.0371900826446281}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008264462809917356, (0, 1): 0.9545454545454546, (0, 2): 0.0371900826446281}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 231.0 -> 232.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 231.0 -> 232.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 284.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=286.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0034965034965034965, (0, 1): 0.993006993006993, (0, 2): 0.0034965034965034965}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0034965034965034965, (0, 1): 0.993006993006993, (0, 2): 0.0034965034965034965}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 284.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=289.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9826989619377162, (1, 1): 0.0034602076124567475, (1, 2): 0.01384083044982699}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9826989619377162, (1, 1): 0.0034602076124567475, (1, 2): 0.01384083044982699}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 284.0 -> 285.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 284.0 -> 285.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 218.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=229.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.039301310043668124, (2, 1): 0.9519650655021834, (2, 2): 0.008733624454148471}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.039301310043668124, (2, 1): 0.9519650655021834, (2, 2): 0.008733624454148471}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 218.0}
in get_filtered_urn(filter=1) --- total: total=230.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.043478260869565216, (1, 1): 0.008695652173913044, (1, 2): 0.9478260869565217}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.043478260869565216, (1, 1): 0.008695652173913044, (1, 2): 0.9478260869565217}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 218.0 -> 219.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 218.0 -> 219.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 324.0}
in get_filtered_urn(filter=1) --- total: total=326.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003067484662576687, (1, 1): 0.003067484662576687, (1, 2): 0.9938650306748467}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003067484662576687, (1, 1): 0.003067484662576687, (1, 2): 0.9938650306748467}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 324.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=326.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003067484662576687, (2, 1): 0.9938650306748467, (2, 2): 0.003067484662576687}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003067484662576687, (2, 1): 0.9938650306748467, (2, 2): 0.003067484662576687}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 324.0 -> 325.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 324.0 -> 325.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 238.0}
in get_filtered_urn(filter=0) --- total: total=250.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008, (0, 1): 0.04, (0, 2): 0.952}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.008, (0, 1): 0.04, (0, 2): 0.952}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 238.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=244.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9754098360655737, (2, 1): 0.01639344262295082, (2, 2): 0.00819672131147541}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9754098360655737, (2, 1): 0.01639344262295082, (2, 2): 0.00819672131147541}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 238.0 -> 239.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 238.0 -> 239.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 325.0}
in get_filtered_urn(filter=1) --- total: total=327.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0030581039755351682, (1, 1): 0.0030581039755351682, (1, 2): 0.9938837920489296}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0030581039755351682, (1, 1): 0.0030581039755351682, (1, 2): 0.9938837920489296}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 325.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=327.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0030581039755351682, (2, 1): 0.9938837920489296, (2, 2): 0.0030581039755351682}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.0030581039755351682, (2, 1): 0.9938837920489296, (2, 2): 0.0030581039755351682}
in decode_message(signal=2) Receiver 2 got option: (2, 0) and decoded action: 0
Receiver 2 received signals: [2] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 0
Receiver 1 received reward: 0
in model.step() --- game 0 --- Sender 1 received reward: 0
Updated weight for option (1, 2): 325.0 -> 325.0
Receiver 2 received reward: 0
in model.step() --- game 0 --- Sender 2 received reward: 0
Updated weight for option (2, 0): 1.0 -> 1.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 219.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=230.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0391304347826087, (2, 1): 0.9521739130434783, (2, 2): 0.008695652173913044}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0391304347826087, (2, 1): 0.9521739130434783, (2, 2): 0.008695652173913044}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 219.0}
in get_filtered_urn(filter=1) --- total: total=231.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04329004329004329, (1, 1): 0.008658008658008658, (1, 2): 0.948051948051948}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04329004329004329, (1, 1): 0.008658008658008658, (1, 2): 0.948051948051948}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 219.0 -> 220.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 219.0 -> 220.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 325.0}
in get_filtered_urn(filter=1) --- total: total=327.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0030581039755351682, (1, 1): 0.0030581039755351682, (1, 2): 0.9938837920489296}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0030581039755351682, (1, 1): 0.0030581039755351682, (1, 2): 0.9938837920489296}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 325.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=327.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0030581039755351682, (2, 1): 0.9938837920489296, (2, 2): 0.0030581039755351682}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0030581039755351682, (2, 1): 0.9938837920489296, (2, 2): 0.0030581039755351682}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 325.0 -> 326.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 325.0 -> 326.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 232.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=238.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9747899159663865, (1, 1): 0.008403361344537815, (1, 2): 0.01680672268907563}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9747899159663865, (1, 1): 0.008403361344537815, (1, 2): 0.01680672268907563}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 232.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=243.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00823045267489712, (0, 1): 0.9547325102880658, (0, 2): 0.037037037037037035}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00823045267489712, (0, 1): 0.9547325102880658, (0, 2): 0.037037037037037035}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 232.0 -> 233.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 232.0 -> 233.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 255.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=260.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9807692307692307, (2, 1): 0.015384615384615385, (2, 2): 0.0038461538461538464}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9807692307692307, (2, 1): 0.015384615384615385, (2, 2): 0.0038461538461538464}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 255.0}
in get_filtered_urn(filter=0) --- total: total=257.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0038910505836575876, (0, 1): 0.0038910505836575876, (0, 2): 0.9922178988326849}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0038910505836575876, (0, 1): 0.0038910505836575876, (0, 2): 0.9922178988326849}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 255.0 -> 256.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 255.0 -> 256.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 239.0}
in get_filtered_urn(filter=0) --- total: total=251.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00796812749003984, (0, 1): 0.0398406374501992, (0, 2): 0.952191235059761}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00796812749003984, (0, 1): 0.0398406374501992, (0, 2): 0.952191235059761}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 239.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=245.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9755102040816327, (2, 1): 0.0163265306122449, (2, 2): 0.00816326530612245}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9755102040816327, (2, 1): 0.0163265306122449, (2, 2): 0.00816326530612245}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 239.0 -> 240.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 239.0 -> 240.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 326.0}
in get_filtered_urn(filter=1) --- total: total=328.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003048780487804878, (1, 1): 0.003048780487804878, (1, 2): 0.9939024390243902}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003048780487804878, (1, 1): 0.003048780487804878, (1, 2): 0.9939024390243902}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 326.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=328.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003048780487804878, (2, 1): 0.9939024390243902, (2, 2): 0.003048780487804878}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003048780487804878, (2, 1): 0.9939024390243902, (2, 2): 0.003048780487804878}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 326.0 -> 327.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 326.0 -> 327.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 233.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=239.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9748953974895398, (1, 1): 0.008368200836820083, (1, 2): 0.016736401673640166}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9748953974895398, (1, 1): 0.008368200836820083, (1, 2): 0.016736401673640166}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 233.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=244.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00819672131147541, (0, 1): 0.9549180327868853, (0, 2): 0.036885245901639344}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00819672131147541, (0, 1): 0.9549180327868853, (0, 2): 0.036885245901639344}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 233.0 -> 234.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 233.0 -> 234.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 285.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=287.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003484320557491289, (0, 1): 0.9930313588850174, (0, 2): 0.003484320557491289}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.003484320557491289, (0, 1): 0.9930313588850174, (0, 2): 0.003484320557491289}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 285.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=290.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9827586206896551, (1, 1): 0.0034482758620689655, (1, 2): 0.013793103448275862}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9827586206896551, (1, 1): 0.0034482758620689655, (1, 2): 0.013793103448275862}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 285.0 -> 286.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 285.0 -> 286.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 220.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=231.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.03896103896103896, (2, 1): 0.9523809523809523, (2, 2): 0.008658008658008658}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.03896103896103896, (2, 1): 0.9523809523809523, (2, 2): 0.008658008658008658}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 220.0}
in get_filtered_urn(filter=1) --- total: total=232.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04310344827586207, (1, 1): 0.008620689655172414, (1, 2): 0.9482758620689655}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04310344827586207, (1, 1): 0.008620689655172414, (1, 2): 0.9482758620689655}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 220.0 -> 221.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 220.0 -> 221.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 286.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=288.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003472222222222222, (0, 1): 0.9930555555555556, (0, 2): 0.003472222222222222}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.003472222222222222, (0, 1): 0.9930555555555556, (0, 2): 0.003472222222222222}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 286.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=291.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9828178694158075, (1, 1): 0.003436426116838488, (1, 2): 0.013745704467353952}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9828178694158075, (1, 1): 0.003436426116838488, (1, 2): 0.013745704467353952}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 286.0 -> 287.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 286.0 -> 287.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 234.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=240.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.975, (1, 1): 0.008333333333333333, (1, 2): 0.016666666666666666}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.975, (1, 1): 0.008333333333333333, (1, 2): 0.016666666666666666}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 234.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=245.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00816326530612245, (0, 1): 0.9551020408163265, (0, 2): 0.036734693877551024}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00816326530612245, (0, 1): 0.9551020408163265, (0, 2): 0.036734693877551024}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 234.0 -> 235.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 234.0 -> 235.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 327.0}
in get_filtered_urn(filter=1) --- total: total=329.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.00303951367781155, (1, 1): 0.00303951367781155, (1, 2): 0.993920972644377}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.00303951367781155, (1, 1): 0.00303951367781155, (1, 2): 0.993920972644377}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 327.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=329.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.00303951367781155, (2, 1): 0.993920972644377, (2, 2): 0.00303951367781155}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.00303951367781155, (2, 1): 0.993920972644377, (2, 2): 0.00303951367781155}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 327.0 -> 328.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 327.0 -> 328.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 221.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=232.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.03879310344827586, (2, 1): 0.9525862068965517, (2, 2): 0.008620689655172414}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.03879310344827586, (2, 1): 0.9525862068965517, (2, 2): 0.008620689655172414}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 221.0}
in get_filtered_urn(filter=1) --- total: total=233.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04291845493562232, (1, 1): 0.008583690987124463, (1, 2): 0.9484978540772532}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04291845493562232, (1, 1): 0.008583690987124463, (1, 2): 0.9484978540772532}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 221.0 -> 222.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 221.0 -> 222.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 287.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=289.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0034602076124567475, (0, 1): 0.9930795847750865, (0, 2): 0.0034602076124567475}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0034602076124567475, (0, 1): 0.9930795847750865, (0, 2): 0.0034602076124567475}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 287.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=292.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9828767123287672, (1, 1): 0.003424657534246575, (1, 2): 0.0136986301369863}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9828767123287672, (1, 1): 0.003424657534246575, (1, 2): 0.0136986301369863}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 287.0 -> 288.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 287.0 -> 288.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 240.0}
in get_filtered_urn(filter=0) --- total: total=252.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007936507936507936, (0, 1): 0.03968253968253968, (0, 2): 0.9523809523809523}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.007936507936507936, (0, 1): 0.03968253968253968, (0, 2): 0.9523809523809523}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 240.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=246.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.975609756097561, (2, 1): 0.016260162601626018, (2, 2): 0.008130081300813009}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.975609756097561, (2, 1): 0.016260162601626018, (2, 2): 0.008130081300813009}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 240.0 -> 241.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 240.0 -> 241.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 328.0}
in get_filtered_urn(filter=1) --- total: total=330.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0030303030303030303, (1, 1): 0.0030303030303030303, (1, 2): 0.9939393939393939}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0030303030303030303, (1, 1): 0.0030303030303030303, (1, 2): 0.9939393939393939}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 328.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=330.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0030303030303030303, (2, 1): 0.9939393939393939, (2, 2): 0.0030303030303030303}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0030303030303030303, (2, 1): 0.9939393939393939, (2, 2): 0.0030303030303030303}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 328.0 -> 329.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 328.0 -> 329.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 222.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=233.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.03862660944206009, (2, 1): 0.9527896995708155, (2, 2): 0.008583690987124463}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.03862660944206009, (2, 1): 0.9527896995708155, (2, 2): 0.008583690987124463}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 222.0}
in get_filtered_urn(filter=1) --- total: total=234.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.042735042735042736, (1, 1): 0.008547008547008548, (1, 2): 0.9487179487179487}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.042735042735042736, (1, 1): 0.008547008547008548, (1, 2): 0.9487179487179487}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 222.0 -> 223.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 222.0 -> 223.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 288.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=290.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0034482758620689655, (0, 1): 0.993103448275862, (0, 2): 0.0034482758620689655}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0034482758620689655, (0, 1): 0.993103448275862, (0, 2): 0.0034482758620689655}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 288.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=293.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9829351535836177, (1, 1): 0.0034129692832764505, (1, 2): 0.013651877133105802}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9829351535836177, (1, 1): 0.0034129692832764505, (1, 2): 0.013651877133105802}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 288.0 -> 289.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 288.0 -> 289.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 223.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=234.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.038461538461538464, (2, 1): 0.9529914529914529, (2, 2): 0.008547008547008548}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.038461538461538464, (2, 1): 0.9529914529914529, (2, 2): 0.008547008547008548}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 223.0}
in get_filtered_urn(filter=1) --- total: total=235.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0425531914893617, (1, 1): 0.00851063829787234, (1, 2): 0.948936170212766}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0425531914893617, (1, 1): 0.00851063829787234, (1, 2): 0.948936170212766}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 223.0 -> 224.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 223.0 -> 224.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 329.0}
in get_filtered_urn(filter=1) --- total: total=331.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0030211480362537764, (1, 1): 0.0030211480362537764, (1, 2): 0.9939577039274925}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0030211480362537764, (1, 1): 0.0030211480362537764, (1, 2): 0.9939577039274925}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 329.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=331.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0030211480362537764, (2, 1): 0.9939577039274925, (2, 2): 0.0030211480362537764}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0030211480362537764, (2, 1): 0.9939577039274925, (2, 2): 0.0030211480362537764}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 329.0 -> 330.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 329.0 -> 330.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 241.0}
in get_filtered_urn(filter=0) --- total: total=253.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007905138339920948, (0, 1): 0.039525691699604744, (0, 2): 0.9525691699604744}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.007905138339920948, (0, 1): 0.039525691699604744, (0, 2): 0.9525691699604744}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 241.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=247.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9757085020242915, (2, 1): 0.016194331983805668, (2, 2): 0.008097165991902834}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9757085020242915, (2, 1): 0.016194331983805668, (2, 2): 0.008097165991902834}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 241.0 -> 242.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 241.0 -> 242.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 289.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=291.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003436426116838488, (0, 1): 0.993127147766323, (0, 2): 0.003436426116838488}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.003436426116838488, (0, 1): 0.993127147766323, (0, 2): 0.003436426116838488}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 289.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=294.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9829931972789115, (1, 1): 0.003401360544217687, (1, 2): 0.013605442176870748}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9829931972789115, (1, 1): 0.003401360544217687, (1, 2): 0.013605442176870748}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 289.0 -> 290.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 289.0 -> 290.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 235.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=241.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.975103734439834, (1, 1): 0.008298755186721992, (1, 2): 0.016597510373443983}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.975103734439834, (1, 1): 0.008298755186721992, (1, 2): 0.016597510373443983}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 235.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=246.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008130081300813009, (0, 1): 0.9552845528455285, (0, 2): 0.036585365853658534}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008130081300813009, (0, 1): 0.9552845528455285, (0, 2): 0.036585365853658534}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 235.0 -> 236.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 235.0 -> 236.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 256.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=261.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9808429118773946, (2, 1): 0.01532567049808429, (2, 2): 0.0038314176245210726}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9808429118773946, (2, 1): 0.01532567049808429, (2, 2): 0.0038314176245210726}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 256.0}
in get_filtered_urn(filter=0) --- total: total=258.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003875968992248062, (0, 1): 0.003875968992248062, (0, 2): 0.9922480620155039}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.003875968992248062, (0, 1): 0.003875968992248062, (0, 2): 0.9922480620155039}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 256.0 -> 257.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 256.0 -> 257.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 242.0}
in get_filtered_urn(filter=0) --- total: total=254.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007874015748031496, (0, 1): 0.03937007874015748, (0, 2): 0.952755905511811}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.007874015748031496, (0, 1): 0.03937007874015748, (0, 2): 0.952755905511811}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 242.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=248.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9758064516129032, (2, 1): 0.016129032258064516, (2, 2): 0.008064516129032258}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9758064516129032, (2, 1): 0.016129032258064516, (2, 2): 0.008064516129032258}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 242.0 -> 243.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 242.0 -> 243.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 290.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=292.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003424657534246575, (0, 1): 0.9931506849315068, (0, 2): 0.003424657534246575}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.003424657534246575, (0, 1): 0.9931506849315068, (0, 2): 0.003424657534246575}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 290.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=295.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9830508474576272, (1, 1): 0.003389830508474576, (1, 2): 0.013559322033898305}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9830508474576272, (1, 1): 0.003389830508474576, (1, 2): 0.013559322033898305}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 290.0 -> 291.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 290.0 -> 291.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 243.0}
in get_filtered_urn(filter=0) --- total: total=255.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00784313725490196, (0, 1): 0.0392156862745098, (0, 2): 0.9529411764705882}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.00784313725490196, (0, 1): 0.0392156862745098, (0, 2): 0.9529411764705882}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 243.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=249.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9759036144578314, (2, 1): 0.01606425702811245, (2, 2): 0.008032128514056224}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9759036144578314, (2, 1): 0.01606425702811245, (2, 2): 0.008032128514056224}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 243.0 -> 244.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 243.0 -> 244.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 257.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=262.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9809160305343512, (2, 1): 0.015267175572519083, (2, 2): 0.003816793893129771}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9809160305343512, (2, 1): 0.015267175572519083, (2, 2): 0.003816793893129771}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 257.0}
in get_filtered_urn(filter=0) --- total: total=259.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003861003861003861, (0, 1): 0.003861003861003861, (0, 2): 0.9922779922779923}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.003861003861003861, (0, 1): 0.003861003861003861, (0, 2): 0.9922779922779923}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 257.0 -> 258.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 257.0 -> 258.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 224.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=235.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.03829787234042553, (2, 1): 0.9531914893617022, (2, 2): 0.00851063829787234}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.03829787234042553, (2, 1): 0.9531914893617022, (2, 2): 0.00851063829787234}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 224.0}
in get_filtered_urn(filter=1) --- total: total=236.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0423728813559322, (1, 1): 0.00847457627118644, (1, 2): 0.9491525423728814}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0423728813559322, (1, 1): 0.00847457627118644, (1, 2): 0.9491525423728814}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 224.0 -> 225.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 224.0 -> 225.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 258.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=263.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9809885931558935, (2, 1): 0.015209125475285171, (2, 2): 0.0038022813688212928}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9809885931558935, (2, 1): 0.015209125475285171, (2, 2): 0.0038022813688212928}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 258.0}
in get_filtered_urn(filter=0) --- total: total=260.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0038461538461538464, (0, 1): 0.0038461538461538464, (0, 2): 0.9923076923076923}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0038461538461538464, (0, 1): 0.0038461538461538464, (0, 2): 0.9923076923076923}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 258.0 -> 259.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 258.0 -> 259.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 236.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=242.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9752066115702479, (1, 1): 0.008264462809917356, (1, 2): 0.01652892561983471}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9752066115702479, (1, 1): 0.008264462809917356, (1, 2): 0.01652892561983471}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 236.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=247.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008097165991902834, (0, 1): 0.9554655870445344, (0, 2): 0.03643724696356275}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008097165991902834, (0, 1): 0.9554655870445344, (0, 2): 0.03643724696356275}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 236.0 -> 237.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 236.0 -> 237.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 330.0}
in get_filtered_urn(filter=1) --- total: total=332.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0030120481927710845, (1, 1): 0.0030120481927710845, (1, 2): 0.9939759036144579}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0030120481927710845, (1, 1): 0.0030120481927710845, (1, 2): 0.9939759036144579}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 330.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=332.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0030120481927710845, (2, 1): 0.9939759036144579, (2, 2): 0.0030120481927710845}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0030120481927710845, (2, 1): 0.9939759036144579, (2, 2): 0.0030120481927710845}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 330.0 -> 331.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 330.0 -> 331.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 225.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=236.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.038135593220338986, (2, 1): 0.9533898305084746, (2, 2): 0.00847457627118644}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.038135593220338986, (2, 1): 0.9533898305084746, (2, 2): 0.00847457627118644}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 225.0}
in get_filtered_urn(filter=1) --- total: total=237.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04219409282700422, (1, 1): 0.008438818565400843, (1, 2): 0.9493670886075949}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04219409282700422, (1, 1): 0.008438818565400843, (1, 2): 0.9493670886075949}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 225.0 -> 226.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 225.0 -> 226.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 291.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=293.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0034129692832764505, (0, 1): 0.9931740614334471, (0, 2): 0.0034129692832764505}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0034129692832764505, (0, 1): 0.9931740614334471, (0, 2): 0.0034129692832764505}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 291.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=296.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9831081081081081, (1, 1): 0.0033783783783783786, (1, 2): 0.013513513513513514}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9831081081081081, (1, 1): 0.0033783783783783786, (1, 2): 0.013513513513513514}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 291.0 -> 292.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 291.0 -> 292.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 226.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=237.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0379746835443038, (2, 1): 0.9535864978902954, (2, 2): 0.008438818565400843}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0379746835443038, (2, 1): 0.9535864978902954, (2, 2): 0.008438818565400843}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 226.0}
in get_filtered_urn(filter=1) --- total: total=238.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04201680672268908, (1, 1): 0.008403361344537815, (1, 2): 0.9495798319327731}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04201680672268908, (1, 1): 0.008403361344537815, (1, 2): 0.9495798319327731}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 226.0 -> 227.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 226.0 -> 227.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 292.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=294.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003401360544217687, (0, 1): 0.9931972789115646, (0, 2): 0.003401360544217687}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.003401360544217687, (0, 1): 0.9931972789115646, (0, 2): 0.003401360544217687}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 292.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=297.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9831649831649831, (1, 1): 0.003367003367003367, (1, 2): 0.013468013468013467}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9831649831649831, (1, 1): 0.003367003367003367, (1, 2): 0.013468013468013467}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 292.0 -> 293.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 292.0 -> 293.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 237.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=243.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9753086419753086, (1, 1): 0.00823045267489712, (1, 2): 0.01646090534979424}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9753086419753086, (1, 1): 0.00823045267489712, (1, 2): 0.01646090534979424}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 237.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=248.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008064516129032258, (0, 1): 0.9556451612903226, (0, 2): 0.036290322580645164}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008064516129032258, (0, 1): 0.9556451612903226, (0, 2): 0.036290322580645164}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 237.0 -> 238.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 237.0 -> 238.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 259.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=264.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9810606060606061, (2, 1): 0.015151515151515152, (2, 2): 0.003787878787878788}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9810606060606061, (2, 1): 0.015151515151515152, (2, 2): 0.003787878787878788}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 259.0}
in get_filtered_urn(filter=0) --- total: total=261.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0038314176245210726, (0, 1): 0.0038314176245210726, (0, 2): 0.9923371647509579}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0038314176245210726, (0, 1): 0.0038314176245210726, (0, 2): 0.9923371647509579}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 259.0 -> 260.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 259.0 -> 260.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 244.0}
in get_filtered_urn(filter=0) --- total: total=256.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0078125, (0, 1): 0.0390625, (0, 2): 0.953125}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0078125, (0, 1): 0.0390625, (0, 2): 0.953125}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 227.0}
in get_filtered_urn(filter=1) --- total: total=239.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04184100418410042, (1, 1): 0.008368200836820083, (1, 2): 0.9497907949790795}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04184100418410042, (1, 1): 0.008368200836820083, (1, 2): 0.9497907949790795}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 227.0 -> 227.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 260.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=265.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9811320754716981, (2, 1): 0.01509433962264151, (2, 2): 0.0037735849056603774}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9811320754716981, (2, 1): 0.01509433962264151, (2, 2): 0.0037735849056603774}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 260.0}
in get_filtered_urn(filter=0) --- total: total=262.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003816793893129771, (0, 1): 0.003816793893129771, (0, 2): 0.9923664122137404}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.003816793893129771, (0, 1): 0.003816793893129771, (0, 2): 0.9923664122137404}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 260.0 -> 261.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 260.0 -> 261.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 238.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=244.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9754098360655737, (1, 1): 0.00819672131147541, (1, 2): 0.01639344262295082}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9754098360655737, (1, 1): 0.00819672131147541, (1, 2): 0.01639344262295082}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 238.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=249.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008032128514056224, (0, 1): 0.9558232931726908, (0, 2): 0.03614457831325301}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008032128514056224, (0, 1): 0.9558232931726908, (0, 2): 0.03614457831325301}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 238.0 -> 239.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 238.0 -> 239.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 331.0}
in get_filtered_urn(filter=1) --- total: total=333.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.003003003003003003, (1, 1): 0.003003003003003003, (1, 2): 0.993993993993994}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.003003003003003003, (1, 1): 0.003003003003003003, (1, 2): 0.993993993993994}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 331.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=333.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.003003003003003003, (2, 1): 0.993993993993994, (2, 2): 0.003003003003003003}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.003003003003003003, (2, 1): 0.993993993993994, (2, 2): 0.003003003003003003}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 331.0 -> 332.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 331.0 -> 332.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 244.0}
in get_filtered_urn(filter=0) --- total: total=256.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0078125, (0, 1): 0.0390625, (0, 2): 0.953125}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0078125, (0, 1): 0.0390625, (0, 2): 0.953125}
Sender 4 got filter 0 choose option: (0, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 227.0}
in get_filtered_urn(filter=1) --- total: total=239.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04184100418410042, (1, 1): 0.008368200836820083, (1, 2): 0.9497907949790795}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04184100418410042, (1, 1): 0.008368200836820083, (1, 2): 0.9497907949790795}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 0
Receiver 4 received reward: 0
in model.step() --- game 1 --- Sender 4 received reward: 0
Updated weight for option (0, 1): 10.0 -> 10.0
Receiver 5 received reward: 0
in model.step() --- game 1 --- Sender 5 received reward: 0
Updated weight for option (1, 2): 227.0 -> 227.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 332.0}
in get_filtered_urn(filter=1) --- total: total=334.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0029940119760479044, (1, 1): 0.0029940119760479044, (1, 2): 0.9940119760479041}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0029940119760479044, (1, 1): 0.0029940119760479044, (1, 2): 0.9940119760479041}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 332.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=334.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0029940119760479044, (2, 1): 0.9940119760479041, (2, 2): 0.0029940119760479044}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0029940119760479044, (2, 1): 0.9940119760479041, (2, 2): 0.0029940119760479044}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 332.0 -> 333.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 332.0 -> 333.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 227.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=238.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.037815126050420166, (2, 1): 0.9537815126050421, (2, 2): 0.008403361344537815}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.037815126050420166, (2, 1): 0.9537815126050421, (2, 2): 0.008403361344537815}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 227.0}
in get_filtered_urn(filter=1) --- total: total=239.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04184100418410042, (1, 1): 0.008368200836820083, (1, 2): 0.9497907949790795}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04184100418410042, (1, 1): 0.008368200836820083, (1, 2): 0.9497907949790795}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 227.0 -> 228.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 227.0 -> 228.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 261.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=266.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.981203007518797, (2, 1): 0.015037593984962405, (2, 2): 0.0037593984962406013}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.981203007518797, (2, 1): 0.015037593984962405, (2, 2): 0.0037593984962406013}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 261.0}
in get_filtered_urn(filter=0) --- total: total=263.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0038022813688212928, (0, 1): 0.0038022813688212928, (0, 2): 0.9923954372623575}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0038022813688212928, (0, 1): 0.0038022813688212928, (0, 2): 0.9923954372623575}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 261.0 -> 262.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 261.0 -> 262.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 228.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=239.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.03765690376569038, (2, 1): 0.9539748953974896, (2, 2): 0.008368200836820083}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.03765690376569038, (2, 1): 0.9539748953974896, (2, 2): 0.008368200836820083}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 228.0}
in get_filtered_urn(filter=1) --- total: total=240.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.041666666666666664, (1, 1): 0.008333333333333333, (1, 2): 0.95}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.041666666666666664, (1, 1): 0.008333333333333333, (1, 2): 0.95}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 228.0 -> 229.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 228.0 -> 229.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 293.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=295.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003389830508474576, (0, 1): 0.9932203389830508, (0, 2): 0.003389830508474576}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.003389830508474576, (0, 1): 0.9932203389830508, (0, 2): 0.003389830508474576}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 293.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=298.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9832214765100671, (1, 1): 0.003355704697986577, (1, 2): 0.013422818791946308}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9832214765100671, (1, 1): 0.003355704697986577, (1, 2): 0.013422818791946308}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 293.0 -> 294.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 293.0 -> 294.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 229.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=240.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0375, (2, 1): 0.9541666666666667, (2, 2): 0.008333333333333333}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0375, (2, 1): 0.9541666666666667, (2, 2): 0.008333333333333333}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 229.0}
in get_filtered_urn(filter=1) --- total: total=241.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04149377593360996, (1, 1): 0.008298755186721992, (1, 2): 0.950207468879668}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04149377593360996, (1, 1): 0.008298755186721992, (1, 2): 0.950207468879668}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 229.0 -> 230.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 229.0 -> 230.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 333.0}
in get_filtered_urn(filter=1) --- total: total=335.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0029850746268656717, (1, 1): 0.0029850746268656717, (1, 2): 0.9940298507462687}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0029850746268656717, (1, 1): 0.0029850746268656717, (1, 2): 0.9940298507462687}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 333.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=335.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0029850746268656717, (2, 1): 0.9940298507462687, (2, 2): 0.0029850746268656717}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0029850746268656717, (2, 1): 0.9940298507462687, (2, 2): 0.0029850746268656717}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 333.0 -> 334.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 333.0 -> 334.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 244.0}
in get_filtered_urn(filter=0) --- total: total=256.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0078125, (0, 1): 0.0390625, (0, 2): 0.953125}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0078125, (0, 1): 0.0390625, (0, 2): 0.953125}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 244.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=250.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.976, (2, 1): 0.016, (2, 2): 0.008}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.976, (2, 1): 0.016, (2, 2): 0.008}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 244.0 -> 245.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 244.0 -> 245.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 262.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=267.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9812734082397003, (2, 1): 0.0149812734082397, (2, 2): 0.003745318352059925}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9812734082397003, (2, 1): 0.0149812734082397, (2, 2): 0.003745318352059925}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 262.0}
in get_filtered_urn(filter=0) --- total: total=264.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003787878787878788, (0, 1): 0.003787878787878788, (0, 2): 0.9924242424242424}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.003787878787878788, (0, 1): 0.003787878787878788, (0, 2): 0.9924242424242424}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 262.0 -> 263.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 262.0 -> 263.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 239.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=245.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9755102040816327, (1, 1): 0.00816326530612245, (1, 2): 0.0163265306122449}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9755102040816327, (1, 1): 0.00816326530612245, (1, 2): 0.0163265306122449}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 239.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=250.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.008, (0, 1): 0.956, (0, 2): 0.036}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.008, (0, 1): 0.956, (0, 2): 0.036}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 239.0 -> 240.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 239.0 -> 240.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 294.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=296.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0033783783783783786, (0, 1): 0.9932432432432432, (0, 2): 0.0033783783783783786}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0033783783783783786, (0, 1): 0.9932432432432432, (0, 2): 0.0033783783783783786}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 294.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=299.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9832775919732442, (1, 1): 0.0033444816053511705, (1, 2): 0.013377926421404682}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9832775919732442, (1, 1): 0.0033444816053511705, (1, 2): 0.013377926421404682}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 294.0 -> 295.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 294.0 -> 295.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 230.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=241.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.03734439834024896, (2, 1): 0.9543568464730291, (2, 2): 0.008298755186721992}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.03734439834024896, (2, 1): 0.9543568464730291, (2, 2): 0.008298755186721992}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 230.0}
in get_filtered_urn(filter=1) --- total: total=242.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04132231404958678, (1, 1): 0.008264462809917356, (1, 2): 0.9504132231404959}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04132231404958678, (1, 1): 0.008264462809917356, (1, 2): 0.9504132231404959}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 230.0 -> 231.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 230.0 -> 231.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 295.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=297.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003367003367003367, (0, 1): 0.9932659932659933, (0, 2): 0.003367003367003367}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.003367003367003367, (0, 1): 0.9932659932659933, (0, 2): 0.003367003367003367}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 295.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=300.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9833333333333333, (1, 1): 0.0033333333333333335, (1, 2): 0.013333333333333334}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9833333333333333, (1, 1): 0.0033333333333333335, (1, 2): 0.013333333333333334}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 295.0 -> 296.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 295.0 -> 296.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 231.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=242.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0371900826446281, (2, 1): 0.9545454545454546, (2, 2): 0.008264462809917356}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0371900826446281, (2, 1): 0.9545454545454546, (2, 2): 0.008264462809917356}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 231.0}
in get_filtered_urn(filter=1) --- total: total=243.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0411522633744856, (1, 1): 0.00823045267489712, (1, 2): 0.9506172839506173}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0411522633744856, (1, 1): 0.00823045267489712, (1, 2): 0.9506172839506173}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 231.0 -> 232.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 231.0 -> 232.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 296.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=298.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.003355704697986577, (0, 1): 0.9932885906040269, (0, 2): 0.003355704697986577}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.003355704697986577, (0, 1): 0.9932885906040269, (0, 2): 0.003355704697986577}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 296.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=301.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9833887043189369, (1, 1): 0.0033222591362126247, (1, 2): 0.013289036544850499}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9833887043189369, (1, 1): 0.0033222591362126247, (1, 2): 0.013289036544850499}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 296.0 -> 297.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 296.0 -> 297.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 232.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=243.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.037037037037037035, (2, 1): 0.9547325102880658, (2, 2): 0.00823045267489712}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.037037037037037035, (2, 1): 0.9547325102880658, (2, 2): 0.00823045267489712}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 232.0}
in get_filtered_urn(filter=1) --- total: total=244.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.040983606557377046, (1, 1): 0.00819672131147541, (1, 2): 0.9508196721311475}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.040983606557377046, (1, 1): 0.00819672131147541, (1, 2): 0.9508196721311475}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 232.0 -> 233.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 232.0 -> 233.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 334.0}
in get_filtered_urn(filter=1) --- total: total=336.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.002976190476190476, (1, 1): 0.002976190476190476, (1, 2): 0.9940476190476191}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.002976190476190476, (1, 1): 0.002976190476190476, (1, 2): 0.9940476190476191}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 334.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=336.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.002976190476190476, (2, 1): 0.9940476190476191, (2, 2): 0.002976190476190476}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.002976190476190476, (2, 1): 0.9940476190476191, (2, 2): 0.002976190476190476}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 334.0 -> 335.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 334.0 -> 335.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 240.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=246.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.975609756097561, (1, 1): 0.008130081300813009, (1, 2): 0.016260162601626018}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.975609756097561, (1, 1): 0.008130081300813009, (1, 2): 0.016260162601626018}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 240.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=251.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.00796812749003984, (0, 1): 0.9561752988047809, (0, 2): 0.035856573705179286}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.00796812749003984, (0, 1): 0.9561752988047809, (0, 2): 0.035856573705179286}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 240.0 -> 241.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 240.0 -> 241.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 335.0}
in get_filtered_urn(filter=1) --- total: total=337.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.002967359050445104, (1, 1): 0.002967359050445104, (1, 2): 0.9940652818991098}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.002967359050445104, (1, 1): 0.002967359050445104, (1, 2): 0.9940652818991098}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 335.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=337.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.002967359050445104, (2, 1): 0.9940652818991098, (2, 2): 0.002967359050445104}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.002967359050445104, (2, 1): 0.9940652818991098, (2, 2): 0.002967359050445104}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 335.0 -> 336.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 335.0 -> 336.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 233.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=244.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.036885245901639344, (2, 1): 0.9549180327868853, (2, 2): 0.00819672131147541}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.036885245901639344, (2, 1): 0.9549180327868853, (2, 2): 0.00819672131147541}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 233.0}
in get_filtered_urn(filter=1) --- total: total=245.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04081632653061224, (1, 1): 0.00816326530612245, (1, 2): 0.9510204081632653}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04081632653061224, (1, 1): 0.00816326530612245, (1, 2): 0.9510204081632653}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 233.0 -> 234.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 233.0 -> 234.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 297.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=299.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0033444816053511705, (0, 1): 0.9933110367892977, (0, 2): 0.0033444816053511705}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0033444816053511705, (0, 1): 0.9933110367892977, (0, 2): 0.0033444816053511705}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 297.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=302.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9834437086092715, (1, 1): 0.0033112582781456954, (1, 2): 0.013245033112582781}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9834437086092715, (1, 1): 0.0033112582781456954, (1, 2): 0.013245033112582781}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 297.0 -> 298.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 297.0 -> 298.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 245.0}
in get_filtered_urn(filter=0) --- total: total=257.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007782101167315175, (0, 1): 0.038910505836575876, (0, 2): 0.953307392996109}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.007782101167315175, (0, 1): 0.038910505836575876, (0, 2): 0.953307392996109}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 245.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=251.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9760956175298805, (2, 1): 0.01593625498007968, (2, 2): 0.00796812749003984}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9760956175298805, (2, 1): 0.01593625498007968, (2, 2): 0.00796812749003984}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 245.0 -> 246.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 245.0 -> 246.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 336.0}
in get_filtered_urn(filter=1) --- total: total=338.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0029585798816568047, (1, 1): 0.0029585798816568047, (1, 2): 0.9940828402366864}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0029585798816568047, (1, 1): 0.0029585798816568047, (1, 2): 0.9940828402366864}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 336.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=338.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0029585798816568047, (2, 1): 0.9940828402366864, (2, 2): 0.0029585798816568047}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0029585798816568047, (2, 1): 0.9940828402366864, (2, 2): 0.0029585798816568047}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 336.0 -> 337.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 336.0 -> 337.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 246.0}
in get_filtered_urn(filter=0) --- total: total=258.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007751937984496124, (0, 1): 0.03875968992248062, (0, 2): 0.9534883720930233}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.007751937984496124, (0, 1): 0.03875968992248062, (0, 2): 0.9534883720930233}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 246.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=252.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9761904761904762, (2, 1): 0.015873015873015872, (2, 2): 0.007936507936507936}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9761904761904762, (2, 1): 0.015873015873015872, (2, 2): 0.007936507936507936}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 246.0 -> 247.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 246.0 -> 247.0
--- Step 0 Game 0 ---
Nature 0 set state 1
in model.step() --- game 0 --- Nature 5 set state 1 in game 0
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 1.0, (1, 1): 1.0, (1, 2): 337.0}
in get_filtered_urn(filter=1) --- total: total=339.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.0029498525073746312, (1, 1): 0.0029498525073746312, (1, 2): 0.9941002949852508}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.0029498525073746312, (1, 1): 0.0029498525073746312, (1, 2): 0.9941002949852508}
Sender 1 got filter 1 choose option: (1, 2) and signaled: 2
Sender 1 chose signal: 2
Sender 1 sends signal: 2 to receiver 2
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 1.0, (2, 1): 337.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=339.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.0029498525073746312, (2, 1): 0.9941002949852508, (2, 2): 0.0029498525073746312}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.0029498525073746312, (2, 1): 0.9941002949852508, (2, 2): 0.0029498525073746312}
in decode_message(signal=2) Receiver 2 got option: (2, 1) and decoded action: 1
Receiver 2 received signals: [2] and action: 1
in model.step() --- game 0 --- Receiver 2 action: 1
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (1, 2): 337.0 -> 338.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (2, 1): 337.0 -> 338.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 241.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=247.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9757085020242915, (1, 1): 0.008097165991902834, (1, 2): 0.016194331983805668}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9757085020242915, (1, 1): 0.008097165991902834, (1, 2): 0.016194331983805668}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 241.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=252.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007936507936507936, (0, 1): 0.9563492063492064, (0, 2): 0.03571428571428571}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.007936507936507936, (0, 1): 0.9563492063492064, (0, 2): 0.03571428571428571}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 241.0 -> 242.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 241.0 -> 242.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 263.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=268.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9813432835820896, (2, 1): 0.014925373134328358, (2, 2): 0.0037313432835820895}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9813432835820896, (2, 1): 0.014925373134328358, (2, 2): 0.0037313432835820895}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 263.0}
in get_filtered_urn(filter=0) --- total: total=265.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0037735849056603774, (0, 1): 0.0037735849056603774, (0, 2): 0.9924528301886792}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0037735849056603774, (0, 1): 0.0037735849056603774, (0, 2): 0.9924528301886792}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 263.0 -> 264.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 263.0 -> 264.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 242.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=248.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9758064516129032, (1, 1): 0.008064516129032258, (1, 2): 0.016129032258064516}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9758064516129032, (1, 1): 0.008064516129032258, (1, 2): 0.016129032258064516}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 242.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=253.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007905138339920948, (0, 1): 0.9565217391304348, (0, 2): 0.03557312252964427}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.007905138339920948, (0, 1): 0.9565217391304348, (0, 2): 0.03557312252964427}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 242.0 -> 243.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 242.0 -> 243.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 298.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=300.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0033333333333333335, (0, 1): 0.9933333333333333, (0, 2): 0.0033333333333333335}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0033333333333333335, (0, 1): 0.9933333333333333, (0, 2): 0.0033333333333333335}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 298.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=303.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9834983498349835, (1, 1): 0.0033003300330033004, (1, 2): 0.013201320132013201}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9834983498349835, (1, 1): 0.0033003300330033004, (1, 2): 0.013201320132013201}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 298.0 -> 299.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 298.0 -> 299.0
--- Step 0 Game 1 ---
Nature 3 set state 0
in model.step() --- game 1 --- Nature 2 set state 0 in game 1
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 10.0, (0, 2): 247.0}
in get_filtered_urn(filter=0) --- total: total=259.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007722007722007722, (0, 1): 0.03861003861003861, (0, 2): 0.9536679536679536}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.007722007722007722, (0, 1): 0.03861003861003861, (0, 2): 0.9536679536679536}
Sender 4 got filter 0 choose option: (0, 2) and signaled: 2
Sender 4 chose signal: 2
Sender 4 sends signal: 2 to receiver 5
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 247.0, (2, 1): 4.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=253.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9762845849802372, (2, 1): 0.015810276679841896, (2, 2): 0.007905138339920948}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9762845849802372, (2, 1): 0.015810276679841896, (2, 2): 0.007905138339920948}
in decode_message(signal=2) Receiver 5 got option: (2, 0) and decoded action: 0
Receiver 5 received signals: [2] and action: 0
in model.step() --- game 1 --- Receiver 5 action: 0
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (0, 2): 247.0 -> 248.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (2, 0): 247.0 -> 248.0
--- Step 0 Game 0 ---
Nature 0 set state 0
in model.step() --- game 0 --- Nature 5 set state 0 in game 0
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 299.0, (0, 2): 1.0}
in get_filtered_urn(filter=0) --- total: total=301.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0033222591362126247, (0, 1): 0.9933554817275747, (0, 2): 0.0033222591362126247}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.0033222591362126247, (0, 1): 0.9933554817275747, (0, 2): 0.0033222591362126247}
Sender 1 got filter 0 choose option: (0, 1) and signaled: 1
Sender 1 chose signal: 1
Sender 1 sends signal: 1 to receiver 2
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 299.0, (1, 1): 1.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=304.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9835526315789473, (1, 1): 0.003289473684210526, (1, 2): 0.013157894736842105}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9835526315789473, (1, 1): 0.003289473684210526, (1, 2): 0.013157894736842105}
in decode_message(signal=1) Receiver 2 got option: (1, 0) and decoded action: 0
Receiver 2 received signals: [1] and action: 0
in model.step() --- game 0 --- Receiver 2 action: 0
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (0, 1): 299.0 -> 300.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (1, 0): 299.0 -> 300.0
--- Step 0 Game 1 ---
Nature 3 set state 1
in model.step() --- game 1 --- Nature 2 set state 1 in game 1
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 243.0, (1, 1): 2.0, (1, 2): 4.0}
in get_filtered_urn(filter=1) --- total: total=249.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.9759036144578314, (1, 1): 0.008032128514056224, (1, 2): 0.01606425702811245}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 0) from urn={(1, 0): 0.9759036144578314, (1, 1): 0.008032128514056224, (1, 2): 0.01606425702811245}
Sender 4 got filter 1 choose option: (1, 0) and signaled: 0
Sender 4 chose signal: 0
Sender 4 sends signal: 0 to receiver 5
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 2.0, (0, 1): 243.0, (0, 2): 9.0}
in get_filtered_urn(filter=0) --- total: total=254.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.007874015748031496, (0, 1): 0.9566929133858267, (0, 2): 0.03543307086614173}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 1) from urn={(0, 0): 0.007874015748031496, (0, 1): 0.9566929133858267, (0, 2): 0.03543307086614173}
in decode_message(signal=0) Receiver 5 got option: (0, 1) and decoded action: 1
Receiver 5 received signals: [0] and action: 1
in model.step() --- game 1 --- Receiver 5 action: 1
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (1, 0): 243.0 -> 244.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (0, 1): 243.0 -> 244.0
--- Step 0 Game 0 ---
Nature 0 set state 2
in model.step() --- game 0 --- Nature 5 set state 2 in game 0
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 264.0, (2, 1): 4.0, (2, 2): 1.0}
in get_filtered_urn(filter=2) --- total: total=269.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.9814126394052045, (2, 1): 0.01486988847583643, (2, 2): 0.0037174721189591076}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 0) from urn={(2, 0): 0.9814126394052045, (2, 1): 0.01486988847583643, (2, 2): 0.0037174721189591076}
Sender 1 got filter 2 choose option: (2, 0) and signaled: 0
Sender 1 chose signal: 0
Sender 1 sends signal: 0 to receiver 2
in get_filtered_urn(filter=0) --- filtered_options: filtered_options=[(0, 0), (0, 1), (0, 2)]
in get_filtered_urn(filter=0) --- filtered_balls: filtered_balls={(0, 0): 1.0, (0, 1): 1.0, (0, 2): 264.0}
in get_filtered_urn(filter=0) --- total: total=266.0
in get_filtered_urn(filter=0) --- returning : normalized_balls={(0, 0): 0.0037593984962406013, (0, 1): 0.0037593984962406013, (0, 2): 0.9924812030075187}
in HerrnsteinRL.choose_option(filter=0) --- chose option=(0, 2) from urn={(0, 0): 0.0037593984962406013, (0, 1): 0.0037593984962406013, (0, 2): 0.9924812030075187}
in decode_message(signal=0) Receiver 2 got option: (0, 2) and decoded action: 2
Receiver 2 received signals: [0] and action: 2
in model.step() --- game 0 --- Receiver 2 action: 2
in model.step() --- game 0 --- Receiver 2 received reward: 1
Receiver 1 received reward: 1
in model.step() --- game 0 --- Sender 1 received reward: 1
Updated weight for option (2, 0): 264.0 -> 265.0
Receiver 2 received reward: 1
in model.step() --- game 0 --- Sender 2 received reward: 1
Updated weight for option (0, 2): 264.0 -> 265.0
--- Step 0 Game 1 ---
Nature 3 set state 2
in model.step() --- game 1 --- Nature 2 set state 2 in game 1
in get_filtered_urn(filter=2) --- filtered_options: filtered_options=[(2, 0), (2, 1), (2, 2)]
in get_filtered_urn(filter=2) --- filtered_balls: filtered_balls={(2, 0): 9.0, (2, 1): 234.0, (2, 2): 2.0}
in get_filtered_urn(filter=2) --- total: total=245.0
in get_filtered_urn(filter=2) --- returning : normalized_balls={(2, 0): 0.036734693877551024, (2, 1): 0.9551020408163265, (2, 2): 0.00816326530612245}
in HerrnsteinRL.choose_option(filter=2) --- chose option=(2, 1) from urn={(2, 0): 0.036734693877551024, (2, 1): 0.9551020408163265, (2, 2): 0.00816326530612245}
Sender 4 got filter 2 choose option: (2, 1) and signaled: 1
Sender 4 chose signal: 1
Sender 4 sends signal: 1 to receiver 5
in get_filtered_urn(filter=1) --- filtered_options: filtered_options=[(1, 0), (1, 1), (1, 2)]
in get_filtered_urn(filter=1) --- filtered_balls: filtered_balls={(1, 0): 10.0, (1, 1): 2.0, (1, 2): 234.0}
in get_filtered_urn(filter=1) --- total: total=246.0
in get_filtered_urn(filter=1) --- returning : normalized_balls={(1, 0): 0.04065040650406504, (1, 1): 0.008130081300813009, (1, 2): 0.9512195121951219}
in HerrnsteinRL.choose_option(filter=1) --- chose option=(1, 2) from urn={(1, 0): 0.04065040650406504, (1, 1): 0.008130081300813009, (1, 2): 0.9512195121951219}
in decode_message(signal=1) Receiver 5 got option: (1, 2) and decoded action: 2
Receiver 5 received signals: [1] and action: 2
in model.step() --- game 1 --- Receiver 5 action: 2
in model.step() --- game 1 --- Receiver 5 received reward: 1
Receiver 4 received reward: 1
in model.step() --- game 1 --- Sender 4 received reward: 1
Updated weight for option (2, 1): 234.0 -> 235.0
Receiver 5 received reward: 1
in model.step() --- game 1 --- Sender 5 received reward: 1
Updated weight for option (1, 2): 234.0 -> 235.0

/home/oren/.local/lib/python3.10/site-packages/mesa/time.py:82: FutureWarning:

The AgentSet is experimental. It may be changed or removed in any and all future releases, including patch releases.
We would love to hear what you think about this new feature. If you have any thoughts, share them with us here: https://github.com/projectmesa/mesa/discussions/1919

/tmp/ipykernel_485066/3700252942.py:248: DeprecationWarning:

Calling np.sum(generator) is deprecated, and in the future will give a different result. Use np.sum(np.fromiter(generator)) or the python sum builtin instead.

Text(0.5, 0, 'Step')

Text(0, 0.5, 'Total Reward')

Text(0.5, 1.0, 'Total Reward over Time')

In this simulation the agents are not learning - they are accessing the predefined signals and actions in the model hence rewards are always 1.

Player in Lewis signaling games can reach three type of equilibria

Separating equilibrium in which receiver fully recovers the state from the signal and can take the appropriate action
Partial pooling equilibrium in which synonyms or homophones frustrate the receiver for always recovering the state.
Full pooling equilibrium in which all signals are the same and the agents are unable to communicate.

A one word synonym for “desired qualities” derived from desire that used in academic literature is “desiderata”.

Skryms next considers bottle necks - which are cases where there are more signals than actions and vica versa.

In the case of more signals than actions successful learning will result a partial polling equilibrium with some synonyms.
In the case of more actions than signals the best an agent can learn is a partial pooling equilibrium with homophones.

Both synonyms and homophones have drawbacks however:

While synonyms increase the cognitive load and the number of signals that need to be learned they do not prevent the recovery of the state being communicated. Homophones require the receiver to select an interpretation at random leading to lower payoffs since the receiver unable to recover the state cannot select the correct action. If the number of signal is the same as the number of actions, the pigeon hole principle guarantees that for every synonym there must be a homophone.

If we consider that for recoverability we need action and signals to be fully correlated it is easy to see that each failure to correlate

action to signals results in a (partial) pooling solution. Thus there are far more partial pooling equilibria than separating equilibria. and it is thus no surprise that natural language is rife with homophones and synonyms.

In lieu of the fact that partial pooling equilibrium far out number the separating ones with and with out bottlenecks, setting up and later learning a separating signaling system with minimal homophones/synonyms is not trivial task. (If we also factor in cost/risk of miscommunication some homophones are clearly worse than others)

Evolution for example may not be the best way for this.
While researchers have very basic algorithms to do so, in terms of convergence rate and sample efficiency.

Although not considered it is easy to see that there are far more partial pooling

We can conclude proceed to discuss the desiderata for learning algorithms.

Note: Dropout Algorithm Introducing bottlenecks into neural networks tend to improve their ability to generalize by forcing them to avoid memorizing inputs and come up with more resiliant representations. This suggest that partial pooling equilibria may play a more significant role in structured/complex signaling systems.

Desiderata for learning algorithms of signaling systems

State recovery - we prefer the algorithm to learn a separating equilibrium and if avoid pooling equilibrium with homophones.
Convergence - we want the algorithm to quickly converge to the equilibrium.
Sample efficiency - we want the algorithm to learn after minimal exposure to stimuli.

Some questions

How different are the task of creating the signaling system from learning it?
- the main difference perhaps is that one party has a mapping and it is up to the second to learn it. they can’t find unused symbols and mach them to a new state.
- there may be many speakers so making changes will be costly.
Can switching roles of sender and receiver give better outcomes in learning ?
- this may change for different extensions
If there are multiple agent learning can create or learn the signaling system better or faster
- what if they have groups with established signal systems
- how can they find a new set of mapping with minimal permutation from their original
If states used for reward are not random are there better schedules for learning are not random

What if each has knowledge of a working signaling system already help adding more players seem to

4 Evolution

The three essential factors in Darwin’s account are

natural variation - mutation, gene flow via migration, genetic drift and recombination in sexual reproduction.
differential reproduction - (Taylor and Jonker 1978) replicator dynamics
inheritance

Taylor, Peter D., and Leo B. Jonker. 1978. “Evolutionarily Stable Strategies and Game Dynamics.” Bellman Prize in Mathematical Biosciences 40: 145–56. https://api.semanticscholar.org/CorpusID:15554796.

ESS

In (Smith and Price 1973) the authors introduced a novel solution concept - the ESS or Evolutionary stable strategy, improving on the notion of the Nash equilibrium by replacing agent level play dominance with statistical dominance of strategies.

ESS Motivating Example Hawk Dove Game

Hawk Dove Game
	Hawk	Dove
Hawk	0	3
Dove	1	2

This explains why hyper-aggressive Hawks type who can defeat more peaceful Doves type do not wipe them out. Hawks have an advantage if there are mostly doves. Once they are in a majority Hawk-Hawk interaction lead to serious injury and death. ESS is a frequency dependent equilibrium.

ESS Criteria

In (Smith and Price 1973) the authors introduce the following criteria in terms of payoffs for a strategy to be an ESS.

Smith, J. Maynard, and G. Randall Price. 1973. “The Logic of Animal Conflict.” Nature 246: 15–18. https://api.semanticscholar.org/CorpusID:4224989.

A strategy, S, is evolutionary stable if for any other strategy, M, either:

Fitness (S played against S) > Fitness (M played against S) or:
Fitnesses are equal against S, but Fitness(S against M) > Fitness(M against M)

Where under the first mutants are expelled quickly and under 2 less so.

Differential Reproduction - Replicator dynamics

Replicator dynamics is driven by Darwinian ﬁtness—expected number of progeny.

so fitness \sim \mathbb E(|progeny|) where on average you get what you expect. For strategy S the population

x_{t}(S) = \frac{x_{t-1}(S) \times fitness(S)}{mean\_fitness}

and for continuous time¹

¹ I think that we should consider a lewis hirarcy of games based on lewis games with
a. logic
b. conjuctive signals

\frac{dx}{dt} = x (fitness(S) - {mean\_fitness})

The main outcomes of this chapter are that for a two state/signal/action Lewis game

Multiple isomorphic signaling systems we could call languages will arise leading to a population of agents split equaly
In a population of agents whose fitness depends on use of the language the stable state is one in which just one of the language is used by the entire population. Other equilibria are unstable which leads to spontaneous breaking of the symmetry and a gradual drift of the population towards one of the stable states.

Notes:

The analysis fails to consider spatial dynamics. It seems that a in a local pockets of language 1, agents with language 2 might have lower fitness.
There is a cost of switching and agents typicaly are not born with a fully formed language ability they need to learn a language and that has costs and requires access to signalers with the said language.
In reality Pidgeons and Creoles are often formed. This is a language that is a mix of two or more languages. This is a partial pooling equilibrium. The existence of creoles suggest that the population dynamics of language formation is more complex than the simple Lewis game.

Langauge intergration problem:

Problem Definition

Given a set of signaling systems {\pi_1,\pi_2,\ldots,\pi_𝑛}, find a permutation \pi_m such that:

\pi_m =\arg \min_\pi \sum_{𝑖=1}^𝑛 d(\pi,\pi_i) where d is the Cayley distance between permutations, i.e. the minimum number of transpositions required to transform one permutation into another.

Solution Approach

Finding the exact median permutation is a computationally challenging task because the problem is NP-hard. However, there are heuristic and approximation methods to approach this problem. One common approach is to use a greedy algorithm that iteratively improves a candidate solution based on the distances to all permutations in the set.

Here is a simple heuristic approach to estimate a solution:

Start with an Initial Guess: You can start with any permutation, such as 𝜋1π1 or any permutation randomly chosen from the set.
Iterative Improvement:
- For each element in the permutation, consider swapping it with every other element.
- Calculate the new total distance after each possible swap.
- If a swap results in a lower total distance, make the swap permanent.
- Repeat this process until no improving swaps are found.

This approach doesn’t guarantee an optimal solution but can often produce a good approximation in a reasonable time frame.

Here’s a Python function that demonstrates this basic heuristic:

import itertools

def cayley_distance(pi, sigma):
    """Calculate the Cayley distance between two permutations."""
    count = 0
    temp = list(pi)
    for i in range(len(pi)):
        while temp[i] != sigma[i]:
            swap_index = temp.index(sigma[i])
            temp[i], temp[swap_index] = temp[swap_index], temp[i]
            count += 1
    return count

def median_permutation(permutations):
    n = len(permutations[0])  # Assuming all permutations are of the same length
    current = list(permutations[0])  # Start with the first permutation as an initial guess
    improving = True

    while improving:
        improving = False
        best_distance = sum(cayley_distance(current, p) for p in permutations)
        for i, j in itertools.combinations(range(n), 2):
            current[i], current[j] = current[j], current[i]  # Swap elements
            new_distance = sum(cayley_distance(current, p) for p in permutations)
            if new_distance < best_distance:
                best_distance = new_distance
                improving = True
            else:
                current[i], current[j] = current[j], current[i]  # Swap back if no improvement

    return current

# Example usage
permutations = [
    [1, 2, 3, 4],
    [2, 1, 4, 3],
    [1, 3, 4, 2],
    [4, 3, 2, 1]
]
print("Median permutation:", median_permutation(permutations))

Median permutation: [1, 2, 3, 4]

/tmp/ipykernel_485066/3341496467.py:21: DeprecationWarning:

Calling np.sum(generator) is deprecated, and in the future will give a different result. Use np.sum(np.fromiter(generator)) or the python sum builtin instead.

/tmp/ipykernel_485066/3341496467.py:24: DeprecationWarning:

Calling np.sum(generator) is deprecated, and in the future will give a different result. Use np.sum(np.fromiter(generator)) or the python sum builtin instead.

Learning

Two type of learning are considered.

Evolution learning using knowledge hard-coded into the genome of the agents. Learning happens though replicator dynamics incorporating randomization followed by natural selection. Also other biologically inspired ideas like mutation and use of a fitness function can come into play.

The down side of Evolution is that is takes many generation for many structures to emerge. (Richard Dawkings states that the evolution of different morphology of the eye are quick taking only 80 generation to evolve in a simulation from the most rudimentary light sensitive cell and elsewhere suggest that 8 generations are needed to see changes in this type of framework.
RL refers to the type of learning from experience by an organism during its lifetime.
Noam Chomsky and others Linguistics hypothesize that Language learning faculties are to a large extent passed through evolution and for this reason individuals can learn languages based on a rather minimal amount of stimulus. This has also be a reason why many in their field abandoned their work on solving linguistics and went on to research the mysteries of the human brain. I feel that to a large extent this book demonstrates that scientifically the notion of the brain requiring a specialized mechanism to evolve/learn complex language is an unnecessary assumption. (Of course it is possible that the brain has co-evolved together with language and that such mechanism do exist.)
1. in one sense the book starts with very simple systems of communication with just a lexicon.
2. The formation of more complex systems with syntax are treated in chapter 12 but these results here seem to satisfy a mathematician or a philosopher etc, without delving into different linguistic niceties that might satisfy a linguist.
3. However the Lewis game needs only a small tweak (the receiver getting multiple partial signals) to allow a signaling system with a grammar to emmerge via Roth-Erev RL. We can also make a categorical statement that this type of RL is a general purpose learning mechanism not a language specific one.

In agents we have learning that is based on evolution and requires subsequent generations of agents becoming fitter.

Here are two conceptual ideas to base RL on

Law of effect: Of several responses made to the same situation, those which are accompanied or closely followed by satisfaction to the animal will, other things being equal, be more ﬁrmly connected with the situation, so that, when it recurs, they will be more likely to recur. — Edward Thorndike, Animal Intelligence, 1911
Law of practice: Learning slows down as reinforcements accrue

Roth–Erev RL alg:

set starting weight for each option
weights evolve by addition of rewards gotten
probability of choosing an alternative is proportional to its weight.

```python RE-RL from mesa import Agent, Model from mesa.time import StagedActivation import random import numpy as np

class LearningRule: def init(self, options, learning_rate=0.1): self.weights = {option: 1.0 for option in options} # Start with equal weights for all options self.learning_rate = learning_rate

def update_weights(self, option, reward):
    # Update the weight of the chosen option by adding the reward scaled by the learning rate
    old_weight = self.weights[option]
    self.weights[option] += self.learning_rate * reward
    print(f"Updated weight for option {option}: {old_weight} -> {self.weights[option]}")

def choose_option(self):
    # Select an option based on the weighted probabilities
    total = sum(self.weights.values())
    probabilities = [self.weights[opt] / total for opt in self.weights]
    return np.random.choice(list(self.weights.keys()), p=probabilities)

class LewisAgent(Agent): def init(self, unique_id, model, learning_options): super().__init__(unique_id, model) self.message = None self.action = None self.reward = 0 self.learning_rule = LearningRule(learning_options, learning_rate=0.1) # Initialize learning with given options

def set_reward(self):
    print(f"Agent {self.unique_id} received reward: {self.reward}")

class Sender(LewisAgent): def send(self): state = self.model.get_state() self.message = self.learning_rule.choose_option() # Send a signal based on the learned weights print(f”Sender {self.unique_id} sends signal for state {state}: {self.message}“)

def update_learning(self):
    self.learning_rule.update_weights(self.model.current_state, self.reward)  # Update weights based on the state and received reward

class Receiver(LewisAgent): def receive(self): self.received_signals = [sender.message for sender in self.model.senders] if self.received_signals: self.action = self.learning_rule.choose_option() # Choose an action based on received signals and learned weights

def calc_reward(self):
    correct_action = self.model.states_actions[self.model.current_state]
    self.reward = 1 if self.action == correct_action else 0
    print(f"Receiver {self.unique_id} calculated reward: {self.reward} for action {self.action}")

def update_learning(self):
    for signal in self.received_signals:
        self.learning_rule.update_weights(signal, self.reward)  # Update weights based on signals and rewards

class SignalingGame(Model): def init(self, senders_count=1, receivers_count=1, state_count=3): super().__init__() self.k = k self.current_state = None

    # Initialize the states, signals, and actions mapping
    self.states_signals = list(range(k))  # States are simply numbers
    self.signals_actions = list(chr(65 + i) for i in range(k))  # Signals are characters

    self.states_actions = {i: i for i in range(k)}  # Mapping states to correct actions

    self.senders = [Sender(i, self, self.signals_actions) for i in range(senders_count)]
    self.receivers = [Receiver(i + senders_count, self, self.signals_actions) for i in range(receivers_count)]
    
    self.schedule = StagedActivation(self, stage_list=['send', 'receive', 'calc_reward', 'set_reward', 'update_learning'])

def get_state(self):
    return random.choice(self.states_signals)

def step(self):
  
    self.current_state = self.get_state()
    print(f"New state of the world: {self.current_state}")
    self.schedule.step()

Running the model

model = SignalingGame(senders_count=1, receivers_count=1, state_count=3) for i in range(10): print(f”— Step {i+1} —“) model.step()


## Bush–Mosteller RL

1.  If an act is chosen and a reward is gotten the probability is incremented by adding some fraction of the distance between the original probability and probability one

    $$
    pr_{new}(A)=(1-\alpha)pr_{old}(A) + a(1)
    $$

2.  Alternative action probabilities are decremented so that everything adds to one

## Goldilocks RL

We consider if there is a Goldilocks point in the RL exploration exploitation dilemma which has a good balance of the two.

-   If we stop learning too fast we are **too cold**

-   If we exploring too much we are **too hot**

-   At the limit is the Goldilocks RL point

**Q: is there Goldilocks RL Alg?**

-   Roth—Erev, Thompson sampling & UCB don't get stuck

-   Epsilon greedy is too hot

-   Bush–Mosteller is too cold

## RL variants:

-   BM variants like dynamically adjusting aspiration levels

-   exponential response rule. The basic idea is to make probabilities proportional to the exponential of past reinforcements. [@Blume2002]

-   best response dynamics, aka Cournot dynamics

## Beyond the book:

-   \^\[citation needed \]\^ investigating RL for this task also suggest that Roth-Erev with forgetting leads to more efficient learning.
-   \^\[citation needed\]\^ Another paper suggest that a learning with a certain prior can be better than Roth-Erev learning.

Adding Learning

::: {#459dd712 .cell execution_count=8}
``` {.python .cell-code}
from mesa import Agent, Model
from mesa.time import StagedActivation
import random

class LewisAgent(Agent):
  
    def __init__(self, unique_id, model):
        super().__init__(unique_id, model)
        self.message = None
        self.action= None

    def send(self):
      pass
    
    def recive(self):
      pass

    def calc_reward(self):
      pass
    
    def set_reward(self):
        self.reward = model.reward
        # Placeholder for learning logic
        print(f"Agent {self.unique_id} received reward: {self.reward}")
 
class Sender(LewisAgent):
  
    def __init__(self, unique_id, model):
        super().__init__(unique_id, model)

    def send(self):
        state = self.model.get_state()
        # Learning to map states to signals
        self.message = self.model.states_signals[state]
        print(f"Sender {self.unique_id} sends signal for state {state}: {self.message}")

class Receiver(LewisAgent):
  
    def __init__(self, unique_id, model):
        super().__init__(unique_id, model)

    def recive(self):
      self.received_signals=[]
      for sender in self.model.senders:
        self.received_signals.append(sender.message)
            # Learning to map signals to actions
      if len(self.received_signals)==1:
        self.action = self.model.signals_actions[self.received_signals[0]]
      else:
        self.action = self.model.signals_actions[self.received_signals[0]]
      

    def calc_reward(self):
      action = self.model.signals_actions[self.received_signals[0]]
      correct_action = self.model.states_actions[self.model.current_state]
      reward = 1 if action == correct_action else 0
      model.reward = reward


class SignalingGame(Model):
    def __init__(self, senders_count=1, recievers_count=1, state_count=3):
        
        super().__init__()
        self.senders_count=senders_count
        self.recievers_count=recievers_count
        self.num_agents = self.recievers_count+self.senders_count

        # e.g., 0 -> A, 1 -> B, ...
        self.states_signals = {i: chr(65 + i) for i in range(k)} 

        # e.g., A -> 0, B -> 1, ...
        self.signals_actions = {chr(65 + i): i for i in range(k)}
        
        # state 0 needs action 0, state 1 needs action 1, ...
        self.states_actions = {i: i for i in range(k)}  
        
        self.current_state = None

        # Create agents
        self.senders = []
        self.receivers=[]
        self.my_agents=[]
        self.uid=0
        for i in range(self.senders_count):
            sender = Sender(self.uid, self)
            self.senders.append(sender)
            self.my_agents.append(sender)
            self.uid +=1
        for j in range (self.recievers_count):
            reciever = Receiver(self.uid, self)
            self.receivers.append(reciever)
            self.my_agents.append(reciever)
            self.uid +=1

        self.schedule = StagedActivation(
          model=self,
          agents=self.my_agents, 
          stage_list = ['send','recive','calc_reward','set_reward']
        )
    
    def get_state(self):
        return self.current_state

    def step(self):
        self.current_state = random.choice(list(self.states_signals.keys()))
        print(f"New state of the world: {self.current_state}")
        self.schedule.step()

# Running the model
k = 3  # Number of states, signals, and actions
steps = 10
model = SignalingGame(senders_count=2,recievers_count=1,state_count=k)
for i in range(steps):
    print(f"--- Step {i+1} ---")
    model.step()

--- Step 1 ---
New state of the world: 1
Sender 0 sends signal for state 1: B
Sender 1 sends signal for state 1: B
Agent 0 received reward: 1
Agent 1 received reward: 1
Agent 2 received reward: 1
--- Step 2 ---
New state of the world: 0
Sender 0 sends signal for state 0: A
Sender 1 sends signal for state 0: A
Agent 0 received reward: 1
Agent 1 received reward: 1
Agent 2 received reward: 1
--- Step 3 ---
New state of the world: 1
Sender 0 sends signal for state 1: B
Sender 1 sends signal for state 1: B
Agent 0 received reward: 1
Agent 1 received reward: 1
Agent 2 received reward: 1
--- Step 4 ---
New state of the world: 1
Sender 0 sends signal for state 1: B
Sender 1 sends signal for state 1: B
Agent 0 received reward: 1
Agent 1 received reward: 1
Agent 2 received reward: 1
--- Step 5 ---
New state of the world: 1
Sender 0 sends signal for state 1: B
Sender 1 sends signal for state 1: B
Agent 0 received reward: 1
Agent 1 received reward: 1
Agent 2 received reward: 1
--- Step 6 ---
New state of the world: 0
Sender 0 sends signal for state 0: A
Sender 1 sends signal for state 0: A
Agent 0 received reward: 1
Agent 1 received reward: 1
Agent 2 received reward: 1
--- Step 7 ---
New state of the world: 1
Sender 0 sends signal for state 1: B
Sender 1 sends signal for state 1: B
Agent 0 received reward: 1
Agent 1 received reward: 1
Agent 2 received reward: 1
--- Step 8 ---
New state of the world: 2
Sender 0 sends signal for state 2: C
Sender 1 sends signal for state 2: C
Agent 0 received reward: 1
Agent 1 received reward: 1
Agent 2 received reward: 1
--- Step 9 ---
New state of the world: 1
Sender 0 sends signal for state 1: B
Sender 1 sends signal for state 1: B
Agent 0 received reward: 1
Agent 1 received reward: 1
Agent 2 received reward: 1
--- Step 10 ---
New state of the world: 0
Sender 0 sends signal for state 0: A
Sender 1 sends signal for state 0: A
Agent 0 received reward: 1
Agent 1 received reward: 1
Agent 2 received reward: 1

:::

11. Networks I: Logic and Information Processing

Logic

Information processing

Inventing the code Game

The world has say four states {S1…S4}. In this extended Lewis game where an agent is a receiver of two messages, each with a partial specification the first is {s1||s2} or {s3||s4} and the second {s1||s3} or {s2||s4}. The agent needs to process the two messages it to get the full state specification and take the appropriate action in response for getting a reward !

The added problem here is that the messages one of two flags, and one of two other flags do not have an established system for the message so learning the content of the signals needs to evolve together with the inference.

The sender can be two agents or one agent with a complex message.

Jeffrey Barrett in Barrett 2007a, 2007b. showed that this can be learned with Roth Erev RL

this is more interesting if there are errors:

is a 10% chance of senders making mistakes with only 3% errors by the receiver?! Skyrms explains this due to the inference being like a taking a vote in a Condorcet signaling system.
receiver errors are considered in (Nowak and Krakauer 1999) where the authors claim they lead to syntax formation.

12. Complex Signals and Compositionality

CCSS: complex composeable signaling systems

The use of complex signals is not unique to humans.
In (Nowak and Krakauer 1999) the authors make a case that complex signals can increase the ﬁdelity of information transmission, by preventing simple signals getting crowded together as the space of potential signals gets ﬁlled up. Also some complex signalsing systems should be simpler to learn. (can we specify a maximaly learnable family?) and process inforamtion
considered CCSS as conffering greater Darwinian fitness in contexts where rich information processing is important.
- Q: Is there a metric for measuring the advantage and or the importance of such information processing needs?
In (Batali 1998) the author investigates the emergence of complex signals in populations of neural nets.
in (Kirby 2002) the author, extends the model in a small population of interacting artiﬁcial agents.
These two papers assume Structured meanings like <John, loves, Mary>. But I am more interested in the ability of evolving arbitrary structures like a sketch map of resources, a distribution of prices, a small bitmap etc.
Skryms takes a similar reductionist POV: finding how to evolve a complex signaling system with minimal departure from the Lewis signaling game and other models already covered….
It is suggested that the “Inventing the code Game” is a sufficient framework creating basic composeable messages. If the receiver considers a sequence of two partial signals as conjunction the and can integrated into one full message!
- Red > Top
- Green> Bottom
- Yellow> Left
- Blue > Right
to signal the state of <bottom, left> a sender can send <green,yellow> or <yellow,green> and the receiver can compose them.
But if it is also possible to evolve and learn order for signals a richer form of composeability become possible. Subject–predicate or operator–sentence.
Sensitivity to temporal order is something many organisms have already developed in responding to perceptual signals.
More generally, we can say that temporal pattern recognition is a fundamental mechanism for anticipating the future.

Nowak, Martin A., and David C. Krakauer. 1999. “The Evolution of Language.” Proceedings of the National Academy of Sciences 96 (14): 8028–33. https://doi.org/10.1073/pnas.96.14.8028.

Batali, J. 1998. “Computational Simulations of the Emergence of Grammar.” In Approaches to the Evolution of Language: Social and Cognitive Bases, edited by J. Hurford, C. Knight, and M. Studdert-Kennedy, 405–26. Cambridge: Cambridge University Press.

Kirby, Simon. 2002. “Natural Language From Artificial Life.” Artificial Life 8 (2): 185–215. https://doi.org/10.1162/106454602320184248.

Skryms points out that temporal order is another mechanism that evolves and that they come together.

Unfortunately Skryms seems to get sidetracked once he point out about order and does not explain how order sensitivity eveloves in “Making the code game”.

from mesa import Agent, Model
from mesa.time import StagedActivation
import random

class LewisAgent(Agent):
  
    def __init__(self, unique_id, model):
        super().__init__(unique_id, model)
        self.message = None
        self.action= None

    def send(self):
      pass
    
    def recive(self):
      pass

    def calc_reward(self):
      pass
    
    def set_reward(self):
        self.reward = model.reward
        # Placeholder for learning logic
        print(f"Agent {self.unique_id} received reward: {self.reward}")
 
class Sender(LewisAgent):
  
    def __init__(self, unique_id, model):
        super().__init__(unique_id, model)

    def send(self):
        state = self.model.get_state()
        
        # Learning to map states to signals
        if type(state) is str:
          self.message = self.model.states_signals[state]
        else:
          self.message = set()
          while len(self.message)>0:
            message = {model.states_signals[self.message.pop()]}
            self.message = self.message.union(message)
        print(f"Sender {self.unique_id} sends signal for state {state}: {self.message}")

class Receiver(LewisAgent):
  
    def __init__(self, unique_id, model):
        super().__init__(unique_id, model)

    def recive(self):
      self.received_signals=[]
      self.action = set()
      
      for sender in self.model.senders:
        self.received_signals.append(sender.message)
        # Learning to map signals to actions
        print(f'{self.received_signals=}')
        print(f'{type(self.received_signals)=}')
        
        for signal_set in self.received_signals:
          actions = set()
          while len(signal_set)>0:
            action  = {model.signals_actions[self.message.pop()]}
            actions  = actions.union(action)
          self.action =  self.action.intersection(actions)
      print(f"Reciever {self.unique_id} action : {self.action}")

    def calc_reward(self):
      action = self.action
      correct_action = self.model.states_actions[self.model.current_state]
      reward = 1 if action == correct_action else 0
      model.reward = reward
      

class SignalingGame(Model):
    def __init__(self, senders_count=1, recievers_count=1, state_count=3):
        
        super().__init__()
        self.senders_count=senders_count
        self.recievers_count=recievers_count
        #self.num_agents = self.recievers_count+self.senders_count

        self.states   = [f'{i}' for i in range(state_count)]
        self.signals = [chr(65 + i) for i in range(state_count)]
        self.actions = [f'{i}' for i in range(state_count)]

        self.current_state = None

        # Create agents
        self.senders = []
        self.receivers=[]
        self.my_agents=[]
        self.uid=0
        
        for i in range(self.senders_count):
            sender = Sender(self.uid, self)
            self.senders.append(sender)
            self.my_agents.append(sender)
            self.uid +=1
        for j in range (self.recievers_count):
            reciever = Receiver(self.uid, self)
            self.receivers.append(reciever)
            self.my_agents.append(reciever)
            self.uid +=1

        self.schedule = StagedActivation(
          model=self,
          agents=self.my_agents, 
          stage_list = ['send','recive','calc_reward','set_reward']
        )
    
        

    def step(self):
        self.current_state = random.choice(list(self.states_signals.keys()))
        self.current_state_set = {random.choice(list(self.states_signals.keys()))}
        print(f"New state of the world: {self.current_state}")
        self.schedule.step()

    def get_state(self):
        if self.senders_count ==1:
          return self.current_state
        else: 
          return {self.current_state, random.choice(list(self.states_signals.keys()))}


# Running the model
state_count = 3  # Number of states, signals, and actions
steps = 10
model = SignalingGame(senders_count=2,recievers_count=1,state_count=state_count)
for i in range(steps):
    print(f"--- Step {i+1} ---")
    model.step()

Some thoughts

learning in the original Lewis language games is exponential in the size of the lexicon. It would seem that some complex signals systems should have orders of magnitude advantage in learning rates compared to the original variants. Lets consider a Lewis signaling system with 27 signals.
The learning is O(e^{27})\propto5\times10^{12}
Under a conjunctive structure with three messages a lexicon of 9 messages would be required.
The learning is O(e^{9})\propto 8.1\times10^{3}
Under Say we have a VSO complex signal with 3 signals per a positional POS category. This leads to 27 signal lexicon under the original lexicon. Using the complex system only 3 three signals need to be learned.
So that learning is O(e^{3}) \propto 20

If we factor learning time as part of the costs of signaling we should expect complex signaling systems to emerge quickly. Also if we consider learning as part of In this case partial pooling states are acceptable and even desirable each signal now has three meaning depending on its position.
In NLP we never see such a perfect utilization of a SS where all synthetically messages are semantically meaningful. On the other hand NLP allow nesting so that sequence like V(VSO)(VSO) corresponding to 3⁸ messages and adding a sub-category modifier prefix (MVMSMO) leads to (3^6) signals 729 signals without
For a simulation - some predators can be introduced into the environment nearby agents will signal it presence. Receivers who take that appropriate action will survive. Those that do not may die. Agent have longevity and must learn the language. When agents die they are replaced by infants without a uniform signaling weights.
Another point is that seems obvious is that if we learn/evolve the lexicon with just one one new word at a time the task becomes trivial. We just need to learn one new state to signal and one new signal to action mapping. But learning just one is a one to one matching. If we have some sense of the salience of the signals we can just order them in that order and we keep increasing fitness…. till we reach some marginal rate of fitness where new signals do almost nothing for our survival.
If we can evolve a complex signaling system we can move to next steps like optimizing our lexicon and grammar for:
1. minimizing communications errors, (error detection and correction)
2. maximizing information transmission. (compression)
3. minimizing cost of acquisition. (acquisition)
4. the trade off between grammatic generalization and easily learnability v.s. making the system harder to learn but more efficient for communication.
5. how do we handle inference (for logic)
6. how do we take advantage of predictability for partial messages
7. what about a convention for grammar - useful for agents that need to exchange data in different formats efficently.
8. Costs of morphotactics - can we do all this in practive with human sound systems. Can we figure our metrics for human languages.
9. Given a (human) language tree can we posit a most pasimonius path for its evolution.

In (Skyrms 2010) the author discusses how a Lewis signaling games can be viewed as a mechanism in which a rudimentary signaling system can give rise to a simple language.

Skyrms, Brian. 2010. “14512 Complex Signals and Compositionality.” In Signals: Evolution, Learning, and Information. Oxford University Press. https://doi.org/10.1093/acprof:oso/9780199580828.003.0013.

The languages arising from Lewis signaling games are limited.

tldr:

The book is aptly nameed signals. It is primarily looking at signaling systems not at anything resembling a fully fledged languages.

What is missing -
- real distribution of states - very large set of messages
- real distribution of messages - a subset of phonology
- a communication protocol over a lossy amd risky channel which can lead to
  - sender may err (most of the RL models in the book - unkike mine lead to making mistakes at a certain frequency)
    - mistakes can happen at either end
    - lewis games have shared reward but mistakes will impact agents assymetricaly
      - recivers taking the wrong action will face greater risks
      - senders making maistakes can
  - sender
  - transmission errors
  - risk related to message length
  - risk associaded with mistakes in the protocol.
  - posibility of partial messages and pressure on shorter messages
    - consideation of “learning by correcting mistakes”
- a grammar
- group dynamics - there are many languages. Languages may have emereged over and over in different locations and grooups seems to have played a major role here. I beleive that a basic model of many agents should lead to rapid
- some constraints
  - distibutional contraints already menthioned
  - basic languages learning must be rapid even if learnig the full system takes years.
    - morphology speed up learning of the lexicon
      - learning k lexemes + a morphology of m productions => k \times m lexicon with a coordiantion cost of k+m
    - syntax allows makes more efficent use of the

The main formalism is the Lewis Signing game. It covers in essense nothing more than coordinating a shared lexcion of signals. There is a lot of effort made to consider the seperating equilibria. But there are many more seperating equilibria and some of these are not only better suited for communications but also emergence of categories a type of messages that can be sepcilized/disambiguated using another signal. However this requires setting up a communication protocol. Lewis signaling can help with the coordination task for that by picking a subset of protocol from many possible options. But there is a second, more salient part - what is the protocol?

Citation

BibTeX citation:

@online{bochman2024,
  author = {Bochman, Oren},
  title = {Skryms {Signals} {Summary} and {Models}},
  date = {2024-05-01},
  url = {https://orenbochman.github.io/posts/2024/2024-05-01-signals/signals-summary.html},
  langid = {en}
}

For attribution, please cite this work as:

Bochman, Oren. 2024. “Skryms Signals Summary and Models.” May 1, 2024. https://orenbochman.github.io/posts/2024/2024-05-01-signals/signals-summary.html.