experimental_experiment.torch_models.phi_helper¶

experimental_experiment.torch_models.phi_helper.get_phi_model(input_dims: Sequence[Tuple[int, int]] = ((13, 7), (14, 7), (15, 8)), hidden_size=32, num_hidden_layers=2, vocab_size=99, intermediate_size=16, max_position_embeddings=512, num_attention_heads=4, num_key_value_heads=2, _attn_implementation='eager', with_mask: bool = True)[source]¶: Returns a model. See PhiConfig. The parameters are chosen for a unit test configuration from test_modeling_phi.py.