Intermediate Computer Vision: Episode 4

So far this tutorial has focused on data pipelines. This lesson introduces model development considerations into the workflow. You can see the source code for the flow here.

In cases where we have a lot of labeled images, deep learning can be an extremely effective modeling technique. This, however, assumes you have access to sufficient resources to train deep learning models. In this episode, you will learn about concepts at the intersection of applied machine learning and cloud development, such as how to use transfer learning models to bootstrap your deep learning workflows and how to iteratively develop models. More specifically, you will use PyTorch and Metaflow to access data and train transfer learning models on hardware accelerators in the cloud.

Effective modeling workflows depend on a robust machine learning stack

1Transfer Learning 101

Transfer learning helps you approach state-of-the-art results without spending too much on resources. It is a common pattern where a machine learning developer resumes the expensive work done to train models (trained by Google, Meta, Microsoft, etc.) instead of discarding it. In this example, we use a general image processing model and fine-tune it to our hand gesture classification use case. To do this, we leverage the build_model function defined in the hagrid package.

from hagrid.classifier.utils import build_model, get_device
model = build_model(model_name = 'MobileNetV3_small', num_classes = 19, device = get_device())

    Building MobileNetV3_small

Under the hood, this package calls one of the classes defined in the models directory, which you can inspect here. The key lines that load the model leverage a custom class like MobileNetV3 that subclasses torch.nn.module.

from models.mobilenetv3 import MobileNetV3
model = MobileNetV3(num_classes=num_classes, size='small', pretrained=pretrained, freezed=freezed)

The custom classes, such as MobileNetV3 in this case, each instantiate a torchvision model.

weights = torchvision.models.MobileNet_V3_Small_Weights if pretrained else None
torchvision_model = torchvision.models.mobilenet_v3_small(weights=weights)

Each custom class has its own constructor and forward step, like all neural networks in PyTorch. An important part of working with transfer learning models is knowing how to stitch together a new output on the end of an existing classifier. For example, in the next code snippet, you can see the contents of the torch constructor for the MobileNetV3 class, and how it uses torchvision to load the models above. Moreover, you can see how the loaded torchvision_model is then loaded with three parts including the "transferred" backbone, the gesture_classifier, and the leading_hand_classifier.

if size == "small":
    weights = torchvision.models.MobileNet_V3_Small_Weights if pretrained else None
    torchvision_model = torchvision.models.mobilenet_v3_small(weights=weights)
    in_features = 576
    out_features = 1024
else:
    weights = torchvision.models.MobileNet_V3_Large_Weights if pretrained else None
    torchvision_model = torchvision.models.mobilenet_v3_large(weights=weights)
    in_features = 960
    out_features = 1280

if freezed:
    for param in torchvision_model.parameters():
        param.requires_grad = False

self.backbone = nn.Sequential(
    torchvision_model.features,
    torchvision_model.avgpool
)

self.gesture_classifier = nn.Sequential(
    nn.Linear(in_features=in_features, out_features=out_features),
    nn.Hardswish(),
    nn.Dropout(p=0.2, inplace=True),
    nn.Linear(in_features=out_features, out_features=num_classes),
)
self.leading_hand_classifier = nn.Sequential(
    nn.Linear(in_features=in_features, out_features=out_features),
    nn.Hardswish(),
    nn.Dropout(p=0.2, inplace=True),
    nn.Linear(in_features=out_features, out_features=2),
)

Then, the forward function that is called when the neural net produces a prediction can then feed the output of the backbone part of the network into both classifiers.

def forward(self, x: Tensor) -> Dict:
    x = self.backbone(x)
    x = x.view(x.size(0), -1)
    gesture = self.gesture_classifier(x)
    leading_hand = self.leading_hand_classifier(x)
    return {"gesture": gesture, "leading_hand": leading_hand}

This is an example of multi-task learning, a pattern that larger, more general models often use. As the model trains, its weights will be updated to improve both the gesture_classifier and leading_hand_classifier. You can view the model architecture with the torchsummary package:

from torchsummary import summary
summary(model)

    ======================================================================
    Layer (type:depth-idx)                        Param #
    ======================================================================
    ├─Sequential: 1-1                             --
    |    └─Sequential: 2-1                        --
    |    |    └─Conv2dNormActivation: 3-1         464
    |    |    └─InvertedResidual: 3-2             744
    |    |    └─InvertedResidual: 3-3             3,864
    |    |    └─InvertedResidual: 3-4             5,416
    |    |    └─InvertedResidual: 3-5             13,736
    |    |    └─InvertedResidual: 3-6             57,264
    |    |    └─InvertedResidual: 3-7             57,264
    |    |    └─InvertedResidual: 3-8             21,968
    |    |    └─InvertedResidual: 3-9             29,800
    |    |    └─InvertedResidual: 3-10            91,848
    |    |    └─InvertedResidual: 3-11            294,096
    |    |    └─InvertedResidual: 3-12            294,096
    |    |    └─Conv2dNormActivation: 3-13        56,448
    |    └─AdaptiveAvgPool2d: 2-2                 --
    ├─Sequential: 1-2                             --
    |    └─Linear: 2-3                            590,848
    |    └─Hardswish: 2-4                         --
    |    └─Dropout: 2-5                           --
    |    └─Linear: 2-6                            19,475
    ├─Sequential: 1-3                             --
    |    └─Linear: 2-7                            590,848
    |    └─Hardswish: 2-8                         --
    |    └─Dropout: 2-9                           --
    |    └─Linear: 2-10                           2,050
    ======================================================================
    Total params: 2,130,229
    Trainable params: 2,130,229
    Non-trainable params: 0
    ======================================================================





    ======================================================================
    Layer (type:depth-idx)                        Param #
    ======================================================================
    ├─Sequential: 1-1                             --
    |    └─Sequential: 2-1                        --
    |    |    └─Conv2dNormActivation: 3-1         464
    |    |    └─InvertedResidual: 3-2             744
    |    |    └─InvertedResidual: 3-3             3,864
    |    |    └─InvertedResidual: 3-4             5,416
    |    |    └─InvertedResidual: 3-5             13,736
    |    |    └─InvertedResidual: 3-6             57,264
    |    |    └─InvertedResidual: 3-7             57,264
    |    |    └─InvertedResidual: 3-8             21,968
    |    |    └─InvertedResidual: 3-9             29,800
    |    |    └─InvertedResidual: 3-10            91,848
    |    |    └─InvertedResidual: 3-11            294,096
    |    |    └─InvertedResidual: 3-12            294,096
    |    |    └─Conv2dNormActivation: 3-13        56,448
    |    └─AdaptiveAvgPool2d: 2-2                 --
    ├─Sequential: 1-2                             --
    |    └─Linear: 2-3                            590,848
    |    └─Hardswish: 2-4                         --
    |    └─Dropout: 2-5                           --
    |    └─Linear: 2-6                            19,475
    ├─Sequential: 1-3                             --
    |    └─Linear: 2-7                            590,848
    |    └─Hardswish: 2-8                         --
    |    └─Dropout: 2-9                           --
    |    └─Linear: 2-10                           2,050
    ======================================================================
    Total params: 2,130,229
    Trainable params: 2,130,229
    Non-trainable params: 0
    ======================================================================

We looked at a single example in this section. You can load one of the following models with the same process: ResNet18, ResNext50, ResNet152, MobileNetV3_small, MobileNetV3_large, or Vitb32.

2Training the Model

Now we have access to data pipelines and powerful models for transfer learning. How do we use them together? The next script shows how to tie together what you have built so far in the following steps:

• Load data using your custom PyTorch Dataset and DataLoader.
• Build a model from MobileNetV3_small.
• Run a single epoch of model training.

# imports and configuration
from hagrid.classifier.run import _initialize_model
from hagrid.classifier.preprocess import get_transform
from hagrid.classifier.dataset import GestureDataset
from hagrid.classifier.utils import build_model, collate_fn, get_device
from hagrid.classifier.train import TrainClassifier
import math
import torch
from omegaconf import OmegaConf
conf = OmegaConf.load('hagrid/classifier/config/default.yaml')
device = 'cpu'

# load data
train_dataset = GestureDataset(is_train=True, conf=conf, transform=get_transform())
train_loader = torch.utils.data.DataLoader(
    train_dataset,
    batch_size=64,
    num_workers=8,
    collate_fn=collate_fn,
    persistent_workers = True,
    shuffle=True
)

# build model
params = [p for p in model.parameters() if p.requires_grad]
optimizer = torch.optim.SGD(
    params,
    lr=conf.optimizer.lr,
    momentum=conf.optimizer.momentum,
    weight_decay=conf.optimizer.weight_decay
)
criterion = torch.nn.CrossEntropyLoss()
model = build_model(model_name = 'MobileNetV3_small', num_classes = 19, device = device)

# run single epoch
for i, (images, labels) in enumerate(train_loader):
    images = torch.stack(list(image.to(device) for image in images))
    output = model(images)
    loss = []
    for target in list(labels)[0].keys():
        target_labels = [label[target] for label in labels]
        target_labels = torch.as_tensor(target_labels).to(device)
        predicted_labels = output[target]
        loss.append(criterion(predicted_labels, target_labels))
    loss = sum(loss)
    loss_value = loss.item()
    if not math.isfinite(loss_value):
        print("Loss is {}, stopping training".format(loss_value))
        exit(1)
    optimizer.zero_grad()
    loss.backward()
    optimizer.step()
    print("Step: {} - Loss {}".format(i, loss_value))

    Building MobileNetV3_small
    Step: 0 - Loss 3.648484230041504
    Step: 1 - Loss 3.644343614578247
    Step: 2 - Loss 3.658726692199707
    Step: 3 - Loss 3.626072645187378
    Step: 4 - Loss 3.6349782943725586
    Step: 5 - Loss 3.6447670459747314
    Step: 6 - Loss 3.6444149017333984
    Step: 7 - Loss 3.639073133468628
    Step: 8 - Loss 3.6401968002319336
    Step: 9 - Loss 3.6476778984069824
    Step: 10 - Loss 3.667464017868042
    Step: 11 - Loss 3.6293206214904785
    Step: 12 - Loss 3.673339605331421
    Step: 13 - Loss 3.6308274269104004
    Step: 14 - Loss 3.6213526725769043
    Step: 15 - Loss 3.6380038261413574
    Step: 16 - Loss 3.6302177906036377
    Step: 17 - Loss 3.648437023162842
    Step: 18 - Loss 3.639798641204834
    Step: 19 - Loss 3.6680898666381836
    Step: 20 - Loss 3.6555967330932617
    Step: 21 - Loss 3.6286935806274414
    Step: 22 - Loss 3.587489604949951

3Challenges when Accessing GPUs

If you ran the code in the previous section, it probably took a little bit of time to finish that single training epoch. It is no secret that hardware accelerators like Nvidia GPUs can help you increase your rate of experimentation. But there is no shortage of difficulties when accessing these machines in a full stack machine learning environment.

With a bit of restructuring the code you've seen so far in this tutorial, Metaflow makes GPU access straightforward for data scientists, data analysts, and operations researchers. Moreover, the stack used in next section's Metaflow will demonstrate a way to set up controls you can use to address the following challenges that emerge when using remote GPU instances:

1. How do you guarantee dependencies on the remote compute instance if you don't have a local GPU?
   • You can create a Docker image and access it with a Metaflow decorator like @batch(image = X) or @kubernetes(image = X).
2. How to efficiently load data batches so you don't pay for idle GPU instances?
   • With Metaflow's @batch(memory = X) or @kubernetes(memory = X) decorators you can control the amount of memory your compute instance needs. This works nicely with PyTorch DataLoader features like tuning the num_workers that are used to load mini-batches in separate processes to feed the model.
3. How to quickly iterate with different transfer learning model heads?
   • In this section, you will see a flow where you can type the model name into the command as a string --model <MODEL_NAME> --checkpoint <S3_PATH_TO_MODEL_NAME>.pth, with the rest of the configuration remaining the same.
4. How do you include local files such as the configuration at hagrid/classifier/config/default.yaml, on the GPU instance?
   • Metaflow flows can be run with the --package-suffixes <FILE EXTENSION> top-level argument. In similar circumstances where you only want to include a single file, you can use Metaflow's IncludeFile parameter.

4The TrainHandGestureClassifier Flow

Now we have all the ingredients we need to encapsulate data loading and model training logic in a flow. The TrainHandGestureClassifier flows shows how you can use Metaflow to

• Request GPU resources when using AWS Batch via Metaflow's @batch decorator.
• Configure the persistent S3 location to track results.
• Download the data onto the compute instance using Metaflow's S3 client.
• Save model checkpoints to S3.

The TrainHandGestureClassifier flow

classifier_flow.py

from metaflow import FlowSpec, Parameter, step, batch, environment, S3, metaflow_config, current

class TrainHandGestureClassifier(FlowSpec):

    S3_URI = Parameter(
        's3', type=str, 
        default='s3://outerbounds-tutorials/computer-vision/hand-gesture-recognition',
        help = 'The s3 uri to the root of the model objects.'
    )

    DATA_ROOT = Parameter(
        'data', type=str, default='data/',
        help = 'The relative location of the training data.'
    )

    IMAGES = Parameter(
        'images', type=str,
        default = 'subsample.zip',
        help = 'The path to the images.'
    )

    ANNOTATIONS = Parameter(
        'annotations', type=str,
        default = 'subsample-annotations.zip'
    )

    PATH_TO_CONFIG = Parameter(
        'config', type=str, 
        default = 'hagrid/classifier/config/default.yaml',
        help = 'The path to classifier training config.'
    )
    
    NUMBER_OF_EPOCHS = Parameter(
        'epochs', type=int, default=100,
        help = 'The number of epochs to train the model from.'
    )

    MODEL_NAME = Parameter(
        'model', type=str,
        default = 'MobileNetV3_small',
        help = '''Pick a model from:
            - [ResNet18, ResNext50, ResNet152, MobileNetV3_small, MobileNetV3_large, Vitb32]
        '''
    )
    
    CHECKPOINT_PATH = Parameter(
        'checkpoint', type=str, default = None, 
        help = 'Path to the model state you want to resume. Eithe'
    )
    
    # # If you do not plan to checkpoint models in S3, then you may want
    # # to use Metaflow's IncludeFile here, instead of this parameter to 
    # # the path. Make sure to import IncludeFile :)
    # CHECKPOINT_PATH = IncludeFile(
    #    'best_model.pth',
    #    is_text=False,
    #    help='The path to your local best_model.pth checkpoint',
    #    default='./best_model.pth'
    # )

    @step
    def start(self):
        # Configure the (remote) experiment tracking location.
        # In this tutorial, experiment tracking means
            # 1: Storing the best model state checkpoints to S3.
            # 2: Storing parameters as Metaflow artifacts.
            # 3: Storing metrics/logs with Tensorboard. 
        import os
        print("Training {} in flow {}".format(self.MODEL_NAME, current.flow_name))
        self.datastore = metaflow_config.DATASTORE_SYSROOT_S3
        self.experiment_storage_prefix = os.path.join(self.datastore, current.flow_name, current.run_id)
        self.next(self.train)

    def _download_data_from_s3(self, file, sample : bool = True):
        import zipfile
        import os
        with S3(s3root = self.S3_URI) as s3:
            if sample:
                path = os.path.join(self.DATA_ROOT, file)
                result = s3.get(path)
                with zipfile.ZipFile(result.path, 'r') as zip_ref:
                    zip_ref.extractall(path.split('.zip')[0])
            else: # Full dataset takes too long for the purpose of this tutorial.
                raise NotImplementedError()

    # 🚨🚨🚨 Do you want to ▶️ on ☁️☁️☁️?
    # You need to be configured with a Metaflow AWS deployment to use this decorator.
    # If you want to run locally, you can comment the `@batch` decorator out.
    @batch(
        gpu=1,
        memory=32000,
        image='eddieob/cv-tutorial:gpu-latest',
        shared_memory=8000,
    )
    @step
    def train(self):
        from hagrid.classifier.run import run_train
        from hagrid.classifier.utils import get_device
        import os
        
        # Download the dataset onto the compute instance.
        if not os.path.exists(self.DATA_ROOT):
            os.mkdir(self.DATA_ROOT)
        print("Downloading images...")
        self._download_data_from_s3(self.IMAGES, sample=True)
        print("Done!")
        print("Downloading annotations...")
        self._download_data_from_s3(self.ANNOTATIONS, sample=True)
        print("Done!")

        # Train a model from available MODEL_NAME options from a checkpoint.
        # There will be errors that happen if CHECKPOINT_PATH doesn't match MODEL_NAME.
        # The user should know which checkpoint paths came from which models.
        self.train_args = dict(
            path_to_config = self.PATH_TO_CONFIG,
            number_of_epochs = self.NUMBER_OF_EPOCHS,
            device = get_device(),
            checkpoint_path = self.CHECKPOINT_PATH,
            model_name = self.MODEL_NAME,
            tensorboard_s3_prefix = self.experiment_storage_prefix,
            always_upload_best_model = True
        )
        _ = run_train(**self.train_args)

        # Move the best model checkpoint to S3 if METAFLOW_DATASTORE_SYSROOT_S3 is available. 
        # See the comment in the start step about setting self.experiment_storage_prefix.
        experiment_path = os.path.join("experiments", self.MODEL_NAME)
        path_to_best_model = os.path.join(experiment_path, 'best_model.pth')
        self.best_model_location = os.path.join(self.experiment_storage_prefix, path_to_best_model)
        if self.best_model_location.startswith('s3://'):
            with S3(s3root = self.experiment_storage_prefix) as s3:
                s3.put_files([(path_to_best_model, path_to_best_model)])
                print("Best model checkpoint saved at {}".format(self.best_model_location))
        self.next(self.end)
        
    @step
    def end(self):
        pass # You could do some fancy analytics, post-processing, or write a nice message here too! 

if __name__ == '__main__':
    TrainHandGestureClassifier()

5Run the TrainHandGestureClassifier Flow

Now it is time to run the TrainHandGestureClassifier. The model can be run using a command structured like this:

python classifier_flow.py --package-suffixes '.yaml' run --model 'ResNet18' --checkpoint 'best_model.pth'

• The configuration file ends in .yaml and we need it to be on the remote instances accessed for the train step. Metaflow has a mechanism to that makes it accessible in the remote compute steps by using --package-suffixes .yaml in the run command.
• The model name is specified using the --model argument. This is defined in the flow parameters.
• The state of the --model to resume from is specified using the --checkpoint argument. This is also defined in the flow parameters.

You can explore more runtime options to add to the run command by investigating the Parameter definitions in the flow definition in the classifier_flow.py file.

python classifier_flow.py --package-suffixes '.yaml' run --epochs 50 --model 'ResNet18'

     Workflow starting (run-id 187928):
     [187928/start/1013657 (pid 97697)] Task is starting.
     [187928/start/1013657 (pid 97697)] Training ResNet18 in flow TrainHandGestureClassifier
     [187928/start/1013657 (pid 97697)] Task finished successfully.
     [187928/train/1013658 (pid 97705)] Task is starting.
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Task is starting (status SUBMITTED)...
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Task is starting (status RUNNABLE)...
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Task is starting (status RUNNABLE)...
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Task is starting (status RUNNABLE)...
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Task is starting (status RUNNABLE)...
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Task is starting (status RUNNABLE)...
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Task is starting (status RUNNABLE)...
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Task is starting (status STARTING)...
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Task is starting (status STARTING)...
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Task is starting (status STARTING)...
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Task is starting (status STARTING)...
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Task is starting (status STARTING)...
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Task is starting (status RUNNING)...
     1 task is running: train (1 running; 0 done).
     No tasks are waiting in the queue.
     end step has not started
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Setting up task environment.
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Downloading code package...
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Code package downloaded.
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Task is starting.
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Downloading images...
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Done!
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Downloading annotations...
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Done!
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Building ResNet18
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:101] INFO     []  Current device: cuda
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 0
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 0: Loss = 3.666109800338745
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1: Loss = 3.723315715789795
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 2: Loss = 3.7935562133789062
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 3: Loss = 3.6560862064361572
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 4: Loss = 3.652635335922241
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 5: Loss = 3.761201858520508
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 6: Loss = 3.7361276149749756
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 7: Loss = 3.6530661582946777
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 8: Loss = 3.6777634620666504
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 9: Loss = 3.5388283729553223
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 10: Loss = 3.5748679637908936
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 11: Loss = 3.6108033657073975
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 12: Loss = 3.6609084606170654
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 13: Loss = 3.504157781600952
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 14: Loss = 3.8126235008239746
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 15: Loss = 3.6089017391204834
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 16: Loss = 3.5710697174072266
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 17: Loss = 3.655522108078003
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 18: Loss = 3.5968339443206787
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 19: Loss = 3.679567813873291
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 20: Loss = 3.4992809295654297
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 21: Loss = 3.444802761077881
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 22: Loss = 3.435945510864258
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.155313, 'f1_score': 0.049964, 'precision': 0.030354, 'recall': 0.155313}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.577657, 'f1_score': 0.423016, 'precision': 0.333687, 'recall': 0.577657}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:251] INFO     []  Saving best model with metric: 0.049964
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Best model checkpoint saved at s3://oleg2-s3-mztdpcvj/metaflow/TrainHandGestureClassifier/187928/experiments/ResNet18/best_model.pth
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 1
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 23: Loss = 3.7300846576690674
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 24: Loss = 3.580991268157959
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 25: Loss = 3.593918561935425
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 26: Loss = 3.7290139198303223
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 27: Loss = 3.6189234256744385
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 28: Loss = 3.514298439025879
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 29: Loss = 3.562411069869995
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 30: Loss = 3.6504437923431396
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 31: Loss = 3.555792808532715
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 32: Loss = 3.353394031524658
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 33: Loss = 3.472313404083252
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 34: Loss = 3.327108860015869
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 35: Loss = 3.51259446144104
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 36: Loss = 3.5872573852539062
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 37: Loss = 3.4279465675354004
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 38: Loss = 3.6514313220977783
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 39: Loss = 3.3613994121551514
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 40: Loss = 3.4117002487182617
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 41: Loss = 3.4929542541503906
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 42: Loss = 3.4612033367156982
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 43: Loss = 3.5202651023864746
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 44: Loss = 3.6968722343444824
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 45: Loss = 3.6309328079223633
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.117166, 'f1_score': 0.07864, 'precision': 0.077518, 'recall': 0.117166}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.572207, 'f1_score': 0.481669, 'precision': 0.562035, 'recall': 0.572207}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:251] INFO     []  Saving best model with metric: 0.07864
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Best model checkpoint saved at s3://oleg2-s3-mztdpcvj/metaflow/TrainHandGestureClassifier/187928/experiments/ResNet18/best_model.pth
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 2
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 46: Loss = 3.4933154582977295
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 47: Loss = 3.524885654449463
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 48: Loss = 3.2599353790283203
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 49: Loss = 3.445143222808838
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 50: Loss = 3.209489107131958
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 51: Loss = 3.4660701751708984
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 52: Loss = 3.223295211791992
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 53: Loss = 3.6636242866516113
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 54: Loss = 3.540006637573242
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 55: Loss = 3.5704305171966553
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 56: Loss = 3.5467116832733154
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 57: Loss = 3.496290445327759
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 58: Loss = 3.4534969329833984
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 59: Loss = 3.4256253242492676
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 60: Loss = 3.3975448608398438
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 61: Loss = 3.5185506343841553
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 62: Loss = 3.480778217315674
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 63: Loss = 3.390482187271118
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 64: Loss = 3.512498617172241
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 65: Loss = 3.6289453506469727
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 66: Loss = 3.5853192806243896
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 67: Loss = 3.490485668182373
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 68: Loss = 3.3356311321258545
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.171662, 'f1_score': 0.111274, 'precision': 0.08916, 'recall': 0.171662}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.621253, 'f1_score': 0.622309, 'precision': 0.626024, 'recall': 0.621253}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:251] INFO     []  Saving best model with metric: 0.111274
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Best model checkpoint saved at s3://oleg2-s3-mztdpcvj/metaflow/TrainHandGestureClassifier/187928/experiments/ResNet18/best_model.pth
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 3
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 69: Loss = 3.300713539123535
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 70: Loss = 3.3323769569396973
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 71: Loss = 3.3825700283050537
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 72: Loss = 3.3053011894226074
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 73: Loss = 3.384507417678833
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 74: Loss = 3.29909086227417
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 75: Loss = 3.3380632400512695
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 76: Loss = 3.4796857833862305
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 77: Loss = 3.2090179920196533
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 78: Loss = 3.410845994949341
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 79: Loss = 3.382451057434082
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 80: Loss = 3.314408302307129
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 81: Loss = 3.155296564102173
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 82: Loss = 3.1960105895996094
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 83: Loss = 3.1857035160064697
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 84: Loss = 3.1834630966186523
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 85: Loss = 3.5269486904144287
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 86: Loss = 3.510385036468506
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 87: Loss = 3.2590746879577637
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 88: Loss = 3.133605480194092
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 89: Loss = 3.376232385635376
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 90: Loss = 3.3225176334381104
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 91: Loss = 3.0812270641326904
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.087193, 'f1_score': 0.070858, 'precision': 0.069589, 'recall': 0.087193}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.46594, 'f1_score': 0.41667, 'precision': 0.566977, 'recall': 0.46594}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 4
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 92: Loss = 3.2465758323669434
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 93: Loss = 3.26517391204834
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 94: Loss = 3.453234910964966
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 95: Loss = 3.249269485473633
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 96: Loss = 3.148533344268799
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 97: Loss = 3.199469566345215
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 98: Loss = 3.3380165100097656
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 99: Loss = 3.437342882156372
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 100: Loss = 3.045222520828247
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 101: Loss = 3.384546995162964
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 102: Loss = 3.0542101860046387
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 103: Loss = 2.932906150817871
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 104: Loss = 3.3756184577941895
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 105: Loss = 3.587024688720703
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 106: Loss = 3.2978951930999756
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 107: Loss = 2.957024097442627
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 108: Loss = 3.3847227096557617
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 109: Loss = 3.2944893836975098
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 110: Loss = 3.3346142768859863
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 111: Loss = 3.2014565467834473
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 112: Loss = 3.2214784622192383
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 113: Loss = 3.5076990127563477
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 114: Loss = 3.2666428089141846
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.152589, 'f1_score': 0.099236, 'precision': 0.078951, 'recall': 0.152589}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.594005, 'f1_score': 0.591419, 'precision': 0.590318, 'recall': 0.594005}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 5
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 115: Loss = 3.145782947540283
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 116: Loss = 3.1589746475219727
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 117: Loss = 3.4069571495056152
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 118: Loss = 3.3704330921173096
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 119: Loss = 3.4599201679229736
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 120: Loss = 3.0337893962860107
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 121: Loss = 3.069847345352173
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 122: Loss = 3.382502317428589
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 123: Loss = 3.172938346862793
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 124: Loss = 3.1989479064941406
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 125: Loss = 2.937016725540161
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 126: Loss = 3.169401168823242
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 127: Loss = 3.198655128479004
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 128: Loss = 3.118258476257324
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 129: Loss = 3.200711965560913
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 130: Loss = 3.3720006942749023
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 131: Loss = 3.1565260887145996
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 132: Loss = 2.993360996246338
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 133: Loss = 3.2345833778381348
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 134: Loss = 3.3898301124572754
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 135: Loss = 3.1570701599121094
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 136: Loss = 3.060731887817383
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 137: Loss = 2.7810404300689697
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.171662, 'f1_score': 0.138493, 'precision': 0.147418, 'recall': 0.171662}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.599455, 'f1_score': 0.596738, 'precision': 0.623919, 'recall': 0.599455}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:251] INFO     []  Saving best model with metric: 0.138493
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Best model checkpoint saved at s3://oleg2-s3-mztdpcvj/metaflow/TrainHandGestureClassifier/187928/experiments/ResNet18/best_model.pth
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 6
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 138: Loss = 2.915949583053589
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 139: Loss = 2.8520092964172363
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 140: Loss = 2.9348974227905273
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 141: Loss = 3.010347843170166
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 142: Loss = 2.9347074031829834
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 143: Loss = 3.119009494781494
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 144: Loss = 2.9503045082092285
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 145: Loss = 3.1625709533691406
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 146: Loss = 3.0211071968078613
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 147: Loss = 3.160278558731079
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 148: Loss = 2.982206106185913
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 149: Loss = 2.8862709999084473
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 150: Loss = 2.9224436283111572
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 151: Loss = 2.9250826835632324
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 152: Loss = 3.1148016452789307
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 153: Loss = 2.8218393325805664
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 154: Loss = 2.92505145072937
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 155: Loss = 2.774503469467163
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 156: Loss = 2.7677364349365234
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 157: Loss = 2.8821909427642822
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 158: Loss = 3.0161783695220947
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 159: Loss = 3.149611234664917
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 160: Loss = 3.089536428451538
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.108992, 'f1_score': 0.112672, 'precision': 0.188828, 'recall': 0.108992}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.673025, 'f1_score': 0.668381, 'precision': 0.675653, 'recall': 0.673025}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 7
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 161: Loss = 3.1307146549224854
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 162: Loss = 2.740689754486084
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 163: Loss = 2.8774096965789795
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 164: Loss = 2.9449455738067627
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 165: Loss = 2.836256504058838
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 166: Loss = 2.9155895709991455
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 167: Loss = 2.7331817150115967
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 168: Loss = 2.967280864715576
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 169: Loss = 2.70485258102417
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 170: Loss = 2.7238802909851074
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 171: Loss = 2.718127727508545
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 172: Loss = 2.7457809448242188
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 173: Loss = 2.4955615997314453
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 174: Loss = 3.0864953994750977
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 175: Loss = 3.2125627994537354
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 176: Loss = 3.0178191661834717
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 177: Loss = 2.8161025047302246
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 178: Loss = 2.85099720954895
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 179: Loss = 2.822877883911133
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 180: Loss = 2.7278683185577393
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 181: Loss = 2.8259174823760986
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 182: Loss = 2.9476277828216553
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 183: Loss = 2.7438459396362305
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.155313, 'f1_score': 0.116737, 'precision': 0.17367, 'recall': 0.155313}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.653951, 'f1_score': 0.652958, 'precision': 0.652443, 'recall': 0.653951}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 8
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 184: Loss = 2.3895132541656494
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 185: Loss = 2.833219051361084
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 186: Loss = 2.9730446338653564
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 187: Loss = 3.123495101928711
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 188: Loss = 2.5561437606811523
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 189: Loss = 2.841137647628784
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 190: Loss = 2.8860745429992676
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 191: Loss = 2.7405967712402344
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 192: Loss = 3.016469717025757
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 193: Loss = 2.6583218574523926
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 194: Loss = 2.7628557682037354
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 195: Loss = 2.775402545928955
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 196: Loss = 2.744995355606079
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 197: Loss = 2.897479295730591
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 198: Loss = 2.8831281661987305
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 199: Loss = 2.868687629699707
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 200: Loss = 2.718263626098633
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 201: Loss = 2.608175277709961
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 202: Loss = 2.623922109603882
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 203: Loss = 2.6932246685028076
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 204: Loss = 2.7590065002441406
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 205: Loss = 2.697783946990967
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 206: Loss = 2.8569579124450684
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.174387, 'f1_score': 0.117304, 'precision': 0.09759, 'recall': 0.174387}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.673025, 'f1_score': 0.674692, 'precision': 0.681178, 'recall': 0.673025}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 9
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 207: Loss = 2.922236204147339
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 208: Loss = 2.6356284618377686
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 209: Loss = 2.6147968769073486
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 210: Loss = 2.266465425491333
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 211: Loss = 2.84298038482666
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 212: Loss = 2.6536712646484375
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 213: Loss = 2.843510150909424
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 214: Loss = 2.473447561264038
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 215: Loss = 2.9304723739624023
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 216: Loss = 2.570230007171631
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 217: Loss = 2.5649852752685547
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 218: Loss = 2.3714797496795654
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 219: Loss = 2.572753429412842
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 220: Loss = 2.8039917945861816
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 221: Loss = 2.61667799949646
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 222: Loss = 2.632213830947876
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 223: Loss = 2.6401610374450684
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 224: Loss = 2.703922986984253
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 225: Loss = 2.540285348892212
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 226: Loss = 2.486694812774658
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 227: Loss = 2.5999279022216797
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 228: Loss = 2.6848368644714355
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 229: Loss = 3.1478867530822754
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.209809, 'f1_score': 0.168751, 'precision': 0.239977, 'recall': 0.209809}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.648501, 'f1_score': 0.650526, 'precision': 0.670448, 'recall': 0.648501}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:251] INFO     []  Saving best model with metric: 0.168751
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Best model checkpoint saved at s3://oleg2-s3-mztdpcvj/metaflow/TrainHandGestureClassifier/187928/experiments/ResNet18/best_model.pth
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 10
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 230: Loss = 2.5797555446624756
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 231: Loss = 2.7372703552246094
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 232: Loss = 2.3740406036376953
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 233: Loss = 2.5410115718841553
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 234: Loss = 2.4688401222229004
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 235: Loss = 2.588651418685913
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 236: Loss = 2.7407586574554443
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 237: Loss = 2.4388999938964844
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 238: Loss = 2.5277321338653564
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 239: Loss = 2.298557758331299
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 240: Loss = 2.6084787845611572
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 241: Loss = 2.6312170028686523
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 242: Loss = 2.4217605590820312
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 243: Loss = 2.381838083267212
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 244: Loss = 2.270127296447754
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 245: Loss = 2.797311544418335
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 246: Loss = 2.6776411533355713
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 247: Loss = 2.4754836559295654
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 248: Loss = 2.4296040534973145
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 249: Loss = 2.357851266860962
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 250: Loss = 2.6999998092651367
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 251: Loss = 2.9698801040649414
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 252: Loss = 3.130159854888916
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.168937, 'f1_score': 0.131744, 'precision': 0.132594, 'recall': 0.168937}
     1 task is running: train (1 running; 0 done).
     No tasks are waiting in the queue.
     end step has not started
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.629428, 'f1_score': 0.626505, 'precision': 0.643894, 'recall': 0.629428}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 11
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Best model checkpoint saved at s3://oleg2-s3-mztdpcvj/metaflow/TrainHandGestureClassifier/187928/experiments/ResNet18/best_model.pth
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 253: Loss = 2.4606571197509766
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 254: Loss = 3.059220314025879
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 255: Loss = 3.081627130508423
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 256: Loss = 3.0170178413391113
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 257: Loss = 2.301989793777466
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 258: Loss = 2.2780706882476807
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 259: Loss = 2.550750732421875
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 260: Loss = 2.550039768218994
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 261: Loss = 2.8061394691467285
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 262: Loss = 2.269094705581665
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 263: Loss = 2.559652328491211
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 264: Loss = 2.4990057945251465
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 265: Loss = 2.3401315212249756
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 266: Loss = 2.4967525005340576
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 267: Loss = 2.3922417163848877
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 268: Loss = 2.5132360458374023
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 269: Loss = 2.4822325706481934
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 270: Loss = 2.390007495880127
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 271: Loss = 2.284658908843994
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 272: Loss = 2.4492411613464355
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 273: Loss = 2.3724117279052734
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 274: Loss = 2.331336498260498
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 275: Loss = 2.350179672241211
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.185286, 'f1_score': 0.143729, 'precision': 0.138617, 'recall': 0.185286}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.689373, 'f1_score': 0.682315, 'precision': 0.690799, 'recall': 0.689373}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 12
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 276: Loss = 2.4940285682678223
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 277: Loss = 2.292165517807007
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 278: Loss = 2.440556526184082
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 279: Loss = 2.191296339035034
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 280: Loss = 2.564404010772705
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 281: Loss = 2.0243446826934814
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 282: Loss = 2.3947746753692627
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 283: Loss = 2.264007806777954
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 284: Loss = 2.044983148574829
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 285: Loss = 2.1888318061828613
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 286: Loss = 2.143162965774536
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 287: Loss = 2.2866532802581787
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 288: Loss = 2.225827693939209
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 289: Loss = 2.4223740100860596
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 290: Loss = 2.5009846687316895
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 291: Loss = 2.493288993835449
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 292: Loss = 2.571366786956787
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 293: Loss = 2.422555446624756
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 294: Loss = 2.378446102142334
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 295: Loss = 2.1158266067504883
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 296: Loss = 2.3768253326416016
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 297: Loss = 2.674111843109131
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 298: Loss = 2.803490400314331
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.247956, 'f1_score': 0.164873, 'precision': 0.181604, 'recall': 0.247956}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.656676, 'f1_score': 0.655666, 'precision': 0.673894, 'recall': 0.656676}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 13
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 299: Loss = 2.148369312286377
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 300: Loss = 2.2359213829040527
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 301: Loss = 2.1308696269989014
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 302: Loss = 2.3725550174713135
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 303: Loss = 2.151116371154785
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 304: Loss = 2.5054209232330322
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 305: Loss = 2.1722464561462402
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 306: Loss = 2.239457607269287
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 307: Loss = 2.1635324954986572
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 308: Loss = 2.0530877113342285
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 309: Loss = 2.2355289459228516
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 310: Loss = 2.328948974609375
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 311: Loss = 2.248546600341797
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 312: Loss = 2.081719398498535
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 313: Loss = 2.046651840209961
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 314: Loss = 1.7771620750427246
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 315: Loss = 2.060209274291992
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 316: Loss = 2.470086097717285
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 317: Loss = 1.869172215461731
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 318: Loss = 2.380913257598877
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 319: Loss = 2.0766611099243164
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 320: Loss = 2.1012444496154785
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 321: Loss = 2.2728638648986816
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.258856, 'f1_score': 0.198825, 'precision': 0.216179, 'recall': 0.258856}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.643052, 'f1_score': 0.629411, 'precision': 0.718616, 'recall': 0.643052}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:251] INFO     []  Saving best model with metric: 0.198825
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 14
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 322: Loss = 2.196927785873413
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 323: Loss = 1.9634981155395508
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 324: Loss = 1.9498653411865234
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 325: Loss = 1.939762830734253
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 326: Loss = 1.995205283164978
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 327: Loss = 2.203486442565918
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 328: Loss = 2.101480007171631
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 329: Loss = 2.023144245147705
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 330: Loss = 2.204651117324829
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 331: Loss = 1.897516131401062
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 332: Loss = 2.344184160232544
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 333: Loss = 1.966691255569458
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 334: Loss = 1.985234260559082
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 335: Loss = 1.997926950454712
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 336: Loss = 2.103156328201294
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 337: Loss = 2.1009905338287354
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 338: Loss = 2.1560208797454834
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 339: Loss = 1.8605707883834839
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 340: Loss = 1.9292305707931519
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 341: Loss = 1.90640127658844
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 342: Loss = 2.2500290870666504
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 343: Loss = 2.2892751693725586
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 344: Loss = 2.3249478340148926
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.250681, 'f1_score': 0.196284, 'precision': 0.261018, 'recall': 0.250681}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.656676, 'f1_score': 0.642978, 'precision': 0.723487, 'recall': 0.656676}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 15
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 345: Loss = 1.9620747566223145
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 346: Loss = 2.060213088989258
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 347: Loss = 2.0805857181549072
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 348: Loss = 1.9234459400177002
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 349: Loss = 2.1590585708618164
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 350: Loss = 2.174957752227783
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 351: Loss = 1.9601861238479614
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 352: Loss = 1.7442076206207275
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 353: Loss = 2.1872167587280273
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 354: Loss = 1.7902371883392334
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 355: Loss = 2.103296995162964
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 356: Loss = 2.0626120567321777
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 357: Loss = 2.0054848194122314
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 358: Loss = 1.9915469884872437
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 359: Loss = 2.1140928268432617
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 360: Loss = 2.1599183082580566
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 361: Loss = 1.591813325881958
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 362: Loss = 1.9733917713165283
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 363: Loss = 1.7052738666534424
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 364: Loss = 1.8836119174957275
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 365: Loss = 1.9375061988830566
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 366: Loss = 2.122737169265747
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 367: Loss = 2.2944271564483643
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.242507, 'f1_score': 0.20247, 'precision': 0.230955, 'recall': 0.242507}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.72752, 'f1_score': 0.712993, 'precision': 0.734594, 'recall': 0.72752}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:251] INFO     []  Saving best model with metric: 0.20247
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Best model checkpoint saved at s3://oleg2-s3-mztdpcvj/metaflow/TrainHandGestureClassifier/187928/experiments/ResNet18/best_model.pth
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 16
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 368: Loss = 1.868208885192871
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 369: Loss = 1.9243236780166626
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 370: Loss = 1.8159593343734741
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 371: Loss = 1.976783275604248
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 372: Loss = 1.8591811656951904
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 373: Loss = 1.7448985576629639
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 374: Loss = 1.8173019886016846
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 375: Loss = 2.199690818786621
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 376: Loss = 2.1902413368225098
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 377: Loss = 2.009110689163208
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 378: Loss = 1.8034117221832275
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 379: Loss = 1.6816365718841553
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 380: Loss = 1.8038482666015625
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 381: Loss = 1.8864775896072388
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 382: Loss = 2.1283931732177734
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 383: Loss = 2.0647757053375244
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 384: Loss = 1.8796000480651855
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 385: Loss = 1.8431776762008667
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 386: Loss = 1.7932419776916504
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 387: Loss = 1.9345893859863281
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 388: Loss = 1.8286516666412354
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 389: Loss = 1.919384241104126
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 390: Loss = 2.4687094688415527
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.277929, 'f1_score': 0.215532, 'precision': 0.277522, 'recall': 0.277929}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.711172, 'f1_score': 0.709445, 'precision': 0.709263, 'recall': 0.711172}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:251] INFO     []  Saving best model with metric: 0.215532
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Best model checkpoint saved at s3://oleg2-s3-mztdpcvj/metaflow/TrainHandGestureClassifier/187928/experiments/ResNet18/best_model.pth
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 17
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 391: Loss = 1.8201040029525757
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 392: Loss = 2.011967897415161
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 393: Loss = 1.8230602741241455
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 394: Loss = 1.6586424112319946
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 395: Loss = 1.7082769870758057
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 396: Loss = 1.6525273323059082
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 397: Loss = 1.8697566986083984
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 398: Loss = 1.4336262941360474
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 399: Loss = 1.6545205116271973
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 400: Loss = 1.591530203819275
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 401: Loss = 1.6412485837936401
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 402: Loss = 1.75431489944458
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 403: Loss = 1.6601858139038086
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 404: Loss = 1.8965567350387573
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 405: Loss = 1.816007137298584
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 406: Loss = 2.0720601081848145
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 407: Loss = 1.9160656929016113
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 408: Loss = 1.5896360874176025
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 409: Loss = 1.6403175592422485
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 410: Loss = 1.9983596801757812
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 411: Loss = 1.5821340084075928
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 412: Loss = 1.6745275259017944
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 413: Loss = 1.5791724920272827
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.3297, 'f1_score': 0.280845, 'precision': 0.346359, 'recall': 0.3297}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.776567, 'f1_score': 0.775877, 'precision': 0.77561, 'recall': 0.776567}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:251] INFO     []  Saving best model with metric: 0.280845
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Best model checkpoint saved at s3://oleg2-s3-mztdpcvj/metaflow/TrainHandGestureClassifier/187928/experiments/ResNet18/best_model.pth
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 18
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 414: Loss = 1.5199187994003296
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 415: Loss = 1.5336501598358154
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 416: Loss = 1.5217386484146118
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 417: Loss = 1.8029807806015015
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 418: Loss = 1.48112952709198
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 419: Loss = 1.5573562383651733
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 420: Loss = 1.5173189640045166
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 421: Loss = 1.6267110109329224
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 422: Loss = 1.6113231182098389
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 423: Loss = 1.4143604040145874
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 424: Loss = 1.444092035293579
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 425: Loss = 1.7642431259155273
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 426: Loss = 1.783109188079834
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 427: Loss = 1.712357759475708
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 428: Loss = 1.512997031211853
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 429: Loss = 1.8527287244796753
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 430: Loss = 1.8340296745300293
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 431: Loss = 1.4631532430648804
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 432: Loss = 1.686973214149475
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 433: Loss = 1.5767122507095337
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 434: Loss = 1.6464934349060059
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 435: Loss = 1.6226744651794434
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 436: Loss = 1.7774834632873535
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.147139, 'f1_score': 0.126498, 'precision': 0.263533, 'recall': 0.147139}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.765668, 'f1_score': 0.763771, 'precision': 0.765655, 'recall': 0.765668}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 19
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 437: Loss = 1.5930229425430298
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 438: Loss = 1.4440735578536987
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 439: Loss = 1.661227822303772
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 440: Loss = 1.2587358951568604
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 441: Loss = 1.520787000656128
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 442: Loss = 1.8180615901947021
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 443: Loss = 1.3284828662872314
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 444: Loss = 1.7925918102264404
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 445: Loss = 1.6450824737548828
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 446: Loss = 1.2099766731262207
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 447: Loss = 1.4969173669815063
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 448: Loss = 1.5732523202896118
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 449: Loss = 1.367757797241211
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 450: Loss = 1.650126576423645
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 451: Loss = 1.5158636569976807
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 452: Loss = 1.7770107984542847
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 453: Loss = 1.54941725730896
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 454: Loss = 1.5252532958984375
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 455: Loss = 1.53102445602417
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 456: Loss = 1.5962448120117188
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 457: Loss = 1.6143732070922852
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 458: Loss = 1.4111409187316895
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 459: Loss = 1.4224125146865845
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.307902, 'f1_score': 0.243002, 'precision': 0.261116, 'recall': 0.307902}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.746594, 'f1_score': 0.732185, 'precision': 0.759992, 'recall': 0.746594}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 20
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 460: Loss = 1.1585983037948608
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 461: Loss = 1.6916950941085815
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 462: Loss = 1.5333716869354248
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 463: Loss = 1.5711946487426758
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 464: Loss = 1.2502940893173218
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 465: Loss = 1.4350618124008179
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 466: Loss = 1.3196165561676025
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 467: Loss = 1.4690617322921753
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 468: Loss = 1.0619239807128906
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 469: Loss = 1.3819634914398193
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 470: Loss = 1.7184529304504395
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 471: Loss = 1.6207209825515747
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 472: Loss = 1.410643458366394
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 473: Loss = 1.5845847129821777
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 474: Loss = 1.4822341203689575
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 475: Loss = 1.462841510772705
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 476: Loss = 1.5182286500930786
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 477: Loss = 1.3560333251953125
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 478: Loss = 1.1260247230529785
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 479: Loss = 1.0662446022033691
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 480: Loss = 1.4711846113204956
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 481: Loss = 1.4761383533477783
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 482: Loss = 0.9519239664077759
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.19891, 'f1_score': 0.163078, 'precision': 0.253122, 'recall': 0.19891}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.678474, 'f1_score': 0.680655, 'precision': 0.687681, 'recall': 0.678474}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 21
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 483: Loss = 1.2773830890655518
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 484: Loss = 1.329742193222046
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 485: Loss = 1.3114153146743774
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 486: Loss = 1.362791657447815
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 487: Loss = 1.1584328413009644
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 488: Loss = 1.2173641920089722
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 489: Loss = 1.0944547653198242
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 490: Loss = 1.2041165828704834
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 491: Loss = 1.131788969039917
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 492: Loss = 1.0785282850265503
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 493: Loss = 1.4485774040222168
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 494: Loss = 1.3668262958526611
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 495: Loss = 1.557913064956665
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 496: Loss = 1.3477842807769775
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 497: Loss = 1.1934454441070557
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 498: Loss = 1.2477105855941772
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 499: Loss = 1.3580186367034912
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 500: Loss = 1.2865897417068481
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 501: Loss = 1.1383556127548218
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 502: Loss = 1.367577075958252
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 503: Loss = 1.1155972480773926
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 504: Loss = 1.2555965185165405
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 505: Loss = 1.6867831945419312
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.286104, 'f1_score': 0.24246, 'precision': 0.269735, 'recall': 0.286104}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.754768, 'f1_score': 0.755385, 'precision': 0.763587, 'recall': 0.754768}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 22
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 506: Loss = 1.197804570198059
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 507: Loss = 1.3817871809005737
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 508: Loss = 1.2869963645935059
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 509: Loss = 1.2508864402770996
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 510: Loss = 1.2394566535949707
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 511: Loss = 1.1506640911102295
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 512: Loss = 1.2405840158462524
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 513: Loss = 1.105400800704956
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 514: Loss = 1.1251929998397827
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 515: Loss = 1.414333462715149
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 516: Loss = 1.303674340248108
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 517: Loss = 1.1546320915222168
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 518: Loss = 1.2711567878723145
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 519: Loss = 1.2160013914108276
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 520: Loss = 1.0813924074172974
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 521: Loss = 1.370511770248413
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 522: Loss = 1.0094563961029053
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 523: Loss = 1.160245418548584
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 524: Loss = 1.3064651489257812
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 525: Loss = 1.142431616783142
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 526: Loss = 1.3470362424850464
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 527: Loss = 1.0715651512145996
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 528: Loss = 1.2922372817993164
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.318801, 'f1_score': 0.298039, 'precision': 0.434644, 'recall': 0.318801}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.741144, 'f1_score': 0.740041, 'precision': 0.739842, 'recall': 0.741144}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:251] INFO     []  Saving best model with metric: 0.298039
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Best model checkpoint saved at s3://oleg2-s3-mztdpcvj/metaflow/TrainHandGestureClassifier/187928/experiments/ResNet18/best_model.pth
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 23
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 529: Loss = 1.0594251155853271
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 530: Loss = 1.3330447673797607
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 531: Loss = 1.041429042816162
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 532: Loss = 1.3083484172821045
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 533: Loss = 0.9573680758476257
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 534: Loss = 1.262035846710205
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 535: Loss = 1.147881031036377
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 536: Loss = 0.9074114561080933
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 537: Loss = 1.194581151008606
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 538: Loss = 1.028809666633606
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 539: Loss = 1.2206177711486816
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 540: Loss = 1.2502367496490479
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 541: Loss = 1.0977424383163452
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 542: Loss = 1.059523582458496
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 543: Loss = 1.325598120689392
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 544: Loss = 0.9836751222610474
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 545: Loss = 1.4663662910461426
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 546: Loss = 0.9327654838562012
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 547: Loss = 1.3361645936965942
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 548: Loss = 1.156570315361023
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 549: Loss = 1.4626219272613525
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 550: Loss = 0.9443935751914978
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 551: Loss = 0.7695249319076538
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.384196, 'f1_score': 0.341613, 'precision': 0.371922, 'recall': 0.384196}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.713897, 'f1_score': 0.695472, 'precision': 0.748061, 'recall': 0.713897}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:251] INFO     []  Saving best model with metric: 0.341613
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Best model checkpoint saved at s3://oleg2-s3-mztdpcvj/metaflow/TrainHandGestureClassifier/187928/experiments/ResNet18/best_model.pth
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 24
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 552: Loss = 1.0093940496444702
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 553: Loss = 1.0480984449386597
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 554: Loss = 1.1220365762710571
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 555: Loss = 1.0717244148254395
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 556: Loss = 1.1528828144073486
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 557: Loss = 1.0698788166046143
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 558: Loss = 0.9983913898468018
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 559: Loss = 1.2048587799072266
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 560: Loss = 0.9369891285896301
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 561: Loss = 1.0362763404846191
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 562: Loss = 0.8542732000350952
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 563: Loss = 0.9920860528945923
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 564: Loss = 1.0640801191329956
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 565: Loss = 1.156159520149231
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 566: Loss = 1.061822772026062
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 567: Loss = 0.9071241617202759
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 568: Loss = 0.8606829643249512
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 569: Loss = 1.0529999732971191
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 570: Loss = 0.9449822902679443
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 571: Loss = 1.1210798025131226
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 572: Loss = 0.796062171459198
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 573: Loss = 1.032547950744629
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 574: Loss = 0.9041776061058044
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.26158, 'f1_score': 0.247839, 'precision': 0.361566, 'recall': 0.26158}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.700273, 'f1_score': 0.672581, 'precision': 0.747875, 'recall': 0.700273}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 25
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 575: Loss = 0.9390881657600403
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 576: Loss = 0.9656282663345337
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 577: Loss = 0.7548589706420898
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 578: Loss = 0.8084976077079773
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 579: Loss = 0.9325253963470459
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 580: Loss = 0.9153419733047485
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 581: Loss = 0.88053297996521
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 582: Loss = 0.9299641847610474
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 583: Loss = 1.0719413757324219
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 584: Loss = 1.2027156352996826
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 585: Loss = 1.0531154870986938
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 586: Loss = 0.8903588652610779
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 587: Loss = 1.154664158821106
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 588: Loss = 0.8678410053253174
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 589: Loss = 0.99811851978302
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 590: Loss = 0.8791002035140991
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 591: Loss = 1.1229557991027832
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 592: Loss = 0.9410426616668701
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 593: Loss = 0.8517215847969055
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 594: Loss = 1.0378773212432861
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 595: Loss = 1.0126644372940063
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 596: Loss = 0.7445764541625977
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 597: Loss = 0.9913071393966675
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.326976, 'f1_score': 0.304699, 'precision': 0.385632, 'recall': 0.326976}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.653951, 'f1_score': 0.582789, 'precision': 0.737023, 'recall': 0.653951}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 26
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 598: Loss = 0.8487460613250732
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 599: Loss = 0.7792590856552124
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 600: Loss = 0.8988111019134521
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 601: Loss = 0.8725464344024658
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 602: Loss = 1.0344420671463013
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 603: Loss = 0.7972512245178223
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 604: Loss = 0.8355419039726257
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 605: Loss = 0.9029000997543335
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 606: Loss = 0.7524174451828003
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 607: Loss = 0.8018144369125366
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 608: Loss = 0.8049155473709106
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 609: Loss = 0.8339362144470215
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 610: Loss = 1.052855134010315
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 611: Loss = 0.7838345170021057
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 612: Loss = 1.174938440322876
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 613: Loss = 0.8105987310409546
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 614: Loss = 0.7215894460678101
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 615: Loss = 0.9572328329086304
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 616: Loss = 0.8812938928604126
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 617: Loss = 1.0010160207748413
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 618: Loss = 0.9242556095123291
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 619: Loss = 0.8311288356781006
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 620: Loss = 0.9599703550338745
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.168937, 'f1_score': 0.076866, 'precision': 0.098111, 'recall': 0.168937}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.662125, 'f1_score': 0.64718, 'precision': 0.752143, 'recall': 0.662125}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 27
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 621: Loss = 1.0119954347610474
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 622: Loss = 0.892216682434082
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 623: Loss = 0.8926986455917358
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 624: Loss = 0.9528816938400269
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 625: Loss = 0.952029824256897
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 626: Loss = 0.8665544986724854
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 627: Loss = 0.7190865278244019
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 628: Loss = 0.780678391456604
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 629: Loss = 0.7434724569320679
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 630: Loss = 0.8019333481788635
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 631: Loss = 0.9905056953430176
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 632: Loss = 0.8310929536819458
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 633: Loss = 0.9643452167510986
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 634: Loss = 0.9240601062774658
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 635: Loss = 1.045639157295227
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 636: Loss = 1.0324137210845947
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 637: Loss = 0.9409884810447693
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 638: Loss = 0.7645037770271301
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 639: Loss = 0.7147113680839539
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 640: Loss = 1.1043275594711304
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 641: Loss = 1.0004934072494507
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 642: Loss = 0.9693183898925781
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 643: Loss = 0.8513844013214111
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.427793, 'f1_score': 0.416919, 'precision': 0.537573, 'recall': 0.427793}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.814714, 'f1_score': 0.8154, 'precision': 0.817301, 'recall': 0.814714}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:251] INFO     []  Saving best model with metric: 0.416919
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Best model checkpoint saved at s3://oleg2-s3-mztdpcvj/metaflow/TrainHandGestureClassifier/187928/experiments/ResNet18/best_model.pth
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 28
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 644: Loss = 0.8192601799964905
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 645: Loss = 0.7713975310325623
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 646: Loss = 1.046162486076355
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 647: Loss = 0.8711909055709839
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 648: Loss = 0.6970689296722412
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 649: Loss = 0.93366539478302
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 650: Loss = 0.9189006090164185
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 651: Loss = 0.9609914422035217
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 652: Loss = 0.8473625183105469
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 653: Loss = 1.295169472694397
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 654: Loss = 0.8229419589042664
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 655: Loss = 0.732751727104187
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 656: Loss = 0.6758886575698853
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 657: Loss = 0.7830586433410645
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 658: Loss = 0.6788736581802368
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 659: Loss = 0.9655038118362427
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 660: Loss = 1.3338329792022705
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 661: Loss = 0.7537195682525635
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 662: Loss = 0.9687275886535645
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 663: Loss = 0.7367368936538696
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 664: Loss = 0.588932454586029
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 665: Loss = 0.8276629447937012
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 666: Loss = 0.610595703125
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.318801, 'f1_score': 0.26819, 'precision': 0.385093, 'recall': 0.318801}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.6703, 'f1_score': 0.61366, 'precision': 0.76424, 'recall': 0.6703}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 29
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 667: Loss = 0.7985436916351318
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 668: Loss = 0.8265352249145508
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 669: Loss = 0.8178824186325073
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 670: Loss = 0.5296768546104431
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 671: Loss = 0.728956937789917
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 672: Loss = 0.6362419128417969
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 673: Loss = 0.5705575346946716
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 674: Loss = 0.6652259230613708
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 675: Loss = 0.6103188991546631
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 676: Loss = 0.7107025384902954
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 677: Loss = 0.6595419049263
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 678: Loss = 0.6844657063484192
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 679: Loss = 0.6676421761512756
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 680: Loss = 0.7174880504608154
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 681: Loss = 0.6503314971923828
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 682: Loss = 0.547723114490509
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 683: Loss = 0.5010077357292175
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 684: Loss = 0.6360020041465759
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 685: Loss = 0.8015025854110718
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 686: Loss = 0.5658787488937378
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 687: Loss = 0.7710233330726624
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 688: Loss = 0.6842898726463318
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 689: Loss = 0.8429622650146484
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.416894, 'f1_score': 0.405683, 'precision': 0.51492, 'recall': 0.416894}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.80109, 'f1_score': 0.798074, 'precision': 0.805583, 'recall': 0.80109}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 30
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 690: Loss = 0.47972050309181213
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 691: Loss = 0.6216998100280762
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 692: Loss = 0.6634224653244019
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 693: Loss = 0.7753338813781738
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 694: Loss = 0.8142688274383545
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 695: Loss = 0.5331761837005615
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 696: Loss = 0.5566721558570862
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 697: Loss = 0.7215845584869385
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 698: Loss = 0.45126649737358093
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 699: Loss = 0.5376794338226318
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 700: Loss = 0.6324023604393005
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 701: Loss = 0.5865973234176636
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 702: Loss = 0.7553213238716125
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 703: Loss = 0.6585307717323303
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 704: Loss = 0.7824088335037231
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 705: Loss = 0.5210727453231812
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 706: Loss = 0.6222569942474365
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 707: Loss = 0.7219393849372864
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 708: Loss = 0.40601181983947754
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 709: Loss = 0.6869033575057983
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 710: Loss = 0.6921002268791199
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 711: Loss = 0.81046462059021
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 712: Loss = 0.8127152919769287
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.433243, 'f1_score': 0.402765, 'precision': 0.473807, 'recall': 0.433243}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.757493, 'f1_score': 0.742565, 'precision': 0.781112, 'recall': 0.757493}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 31
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 713: Loss = 0.5618683099746704
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 714: Loss = 0.5404912829399109
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 715: Loss = 0.47763150930404663
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 716: Loss = 0.4666403532028198
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 717: Loss = 0.3933703601360321
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 718: Loss = 0.48068925738334656
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 719: Loss = 0.49657875299453735
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 720: Loss = 0.5096785426139832
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 721: Loss = 0.7219476103782654
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 722: Loss = 0.5728629231452942
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 723: Loss = 0.8055445551872253
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 724: Loss = 0.5325968265533447
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 725: Loss = 0.3564950227737427
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 726: Loss = 0.5457642078399658
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 727: Loss = 0.7010347247123718
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 728: Loss = 0.6817342042922974
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 729: Loss = 0.7582029700279236
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 730: Loss = 0.513945996761322
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 731: Loss = 0.575345516204834
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 732: Loss = 0.6764234304428101
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 733: Loss = 0.9767245054244995
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 734: Loss = 0.5253771543502808
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 735: Loss = 1.2145262956619263
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.416894, 'f1_score': 0.400522, 'precision': 0.518468, 'recall': 0.416894}
     1 task is running: train (1 running; 0 done).
     No tasks are waiting in the queue.
     end step has not started
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.784741, 'f1_score': 0.784377, 'precision': 0.822927, 'recall': 0.784741}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 32
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Best model checkpoint saved at s3://oleg2-s3-mztdpcvj/metaflow/TrainHandGestureClassifier/187928/experiments/ResNet18/best_model.pth
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Best model checkpoint saved at s3://oleg2-s3-mztdpcvj/metaflow/TrainHandGestureClassifier/187928/experiments/ResNet18/best_model.pth
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Best model checkpoint saved at s3://oleg2-s3-mztdpcvj/metaflow/TrainHandGestureClassifier/187928/experiments/ResNet18/best_model.pth
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Best model checkpoint saved at s3://oleg2-s3-mztdpcvj/metaflow/TrainHandGestureClassifier/187928/experiments/ResNet18/best_model.pth
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 736: Loss = 0.6622775197029114
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 737: Loss = 0.8383904695510864
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 738: Loss = 0.6958779692649841
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 739: Loss = 0.5899982452392578
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 740: Loss = 0.4020814299583435
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 741: Loss = 0.4760001003742218
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 742: Loss = 0.6719167232513428
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 743: Loss = 0.511951744556427
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 744: Loss = 0.4682405889034271
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 745: Loss = 0.4946720600128174
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 746: Loss = 0.5457252264022827
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 747: Loss = 0.408811092376709
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 748: Loss = 0.6280410289764404
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 749: Loss = 0.5118235349655151
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 750: Loss = 0.4910910725593567
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 751: Loss = 0.49194276332855225
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 752: Loss = 0.47651031613349915
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 753: Loss = 0.43368178606033325
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 754: Loss = 0.554534912109375
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 755: Loss = 0.5137138962745667
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 756: Loss = 0.7747101783752441
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 757: Loss = 0.5142617225646973
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 758: Loss = 0.5544673204421997
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.53951, 'f1_score': 0.5246, 'precision': 0.568303, 'recall': 0.53951}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.822888, 'f1_score': 0.816305, 'precision': 0.845811, 'recall': 0.822888}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:251] INFO     []  Saving best model with metric: 0.5246
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 33
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 759: Loss = 0.39838892221450806
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 760: Loss = 0.6001080274581909
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 761: Loss = 0.4679109752178192
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 762: Loss = 0.34789156913757324
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 763: Loss = 0.2209189236164093
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 764: Loss = 0.4115447998046875
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 765: Loss = 0.5469132661819458
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 766: Loss = 0.5654333233833313
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 767: Loss = 0.6256199479103088
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 768: Loss = 0.4263613820075989
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 769: Loss = 0.31536582112312317
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 770: Loss = 0.2977236211299896
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 771: Loss = 0.4923003911972046
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 772: Loss = 0.3946188986301422
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 773: Loss = 0.3874262869358063
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 774: Loss = 0.3332841992378235
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 775: Loss = 0.5255489945411682
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 776: Loss = 0.4979998469352722
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 777: Loss = 0.4782133102416992
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 778: Loss = 0.3472543954849243
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 779: Loss = 0.41421401500701904
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 780: Loss = 0.2945655286312103
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 781: Loss = 0.7883800268173218
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.493188, 'f1_score': 0.463057, 'precision': 0.533727, 'recall': 0.493188}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.841962, 'f1_score': 0.843307, 'precision': 0.851849, 'recall': 0.841962}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 34
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 782: Loss = 0.3549763560295105
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 783: Loss = 0.40189775824546814
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 784: Loss = 0.4176643490791321
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 785: Loss = 0.3488074839115143
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 786: Loss = 0.3898206651210785
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 787: Loss = 0.27787160873413086
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 788: Loss = 0.5264532566070557
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 789: Loss = 0.5883853435516357
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 790: Loss = 0.430228054523468
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 791: Loss = 0.25526317954063416
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 792: Loss = 0.37823203206062317
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 793: Loss = 0.3787400722503662
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 794: Loss = 0.42557376623153687
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 795: Loss = 0.41251641511917114
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 796: Loss = 0.3381231427192688
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 797: Loss = 0.31078189611434937
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 798: Loss = 0.2537660598754883
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 799: Loss = 0.4675693213939667
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 800: Loss = 0.45863258838653564
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 801: Loss = 0.3121858835220337
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 802: Loss = 0.4945667088031769
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 803: Loss = 0.39789626002311707
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 804: Loss = 0.4004504084587097
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.46049, 'f1_score': 0.430436, 'precision': 0.530801, 'recall': 0.46049}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.771117, 'f1_score': 0.769702, 'precision': 0.817219, 'recall': 0.771117}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 35
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 805: Loss = 0.2890801429748535
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 806: Loss = 0.28398364782333374
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 807: Loss = 0.40557414293289185
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 808: Loss = 0.46768462657928467
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 809: Loss = 0.39442384243011475
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 810: Loss = 0.2909725308418274
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 811: Loss = 0.3910027742385864
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 812: Loss = 0.2683566212654114
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 813: Loss = 0.396248459815979
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 814: Loss = 0.31623175740242004
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 815: Loss = 0.3643375337123871
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 816: Loss = 0.3659655749797821
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 817: Loss = 0.39938390254974365
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 818: Loss = 0.37940821051597595
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 819: Loss = 0.3096519708633423
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 820: Loss = 0.35601264238357544
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 821: Loss = 0.27757447957992554
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 822: Loss = 0.31061744689941406
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 823: Loss = 0.40416792035102844
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 824: Loss = 0.3219221532344818
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 825: Loss = 0.5217804312705994
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 826: Loss = 0.37139689922332764
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 827: Loss = 0.4720718264579773
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.476839, 'f1_score': 0.468412, 'precision': 0.555001, 'recall': 0.476839}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.798365, 'f1_score': 0.793776, 'precision': 0.805749, 'recall': 0.798365}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 36
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 828: Loss = 0.2828284502029419
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 829: Loss = 0.26638853549957275
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 830: Loss = 0.4517303705215454
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 831: Loss = 0.24416083097457886
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 832: Loss = 0.2949081063270569
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 833: Loss = 0.24823793768882751
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 834: Loss = 0.3345981240272522
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 835: Loss = 0.32740524411201477
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 836: Loss = 0.2787717282772064
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 837: Loss = 0.3357285261154175
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 838: Loss = 0.5475150942802429
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 839: Loss = 0.37613558769226074
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 840: Loss = 0.2799273133277893
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 841: Loss = 0.2447824478149414
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 842: Loss = 0.4089576005935669
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 843: Loss = 0.2875244617462158
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 844: Loss = 0.3657844364643097
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 845: Loss = 0.368533730506897
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 846: Loss = 0.5336421132087708
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 847: Loss = 0.25935444235801697
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 848: Loss = 0.27640390396118164
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 849: Loss = 0.27260082960128784
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 850: Loss = 0.32601284980773926
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.468665, 'f1_score': 0.43919, 'precision': 0.514236, 'recall': 0.468665}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.768392, 'f1_score': 0.755947, 'precision': 0.803927, 'recall': 0.768392}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 37
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 851: Loss = 0.2159925401210785
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 852: Loss = 0.24157290160655975
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 853: Loss = 0.264082133769989
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 854: Loss = 0.20427583158016205
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 855: Loss = 0.277246356010437
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 856: Loss = 0.26809147000312805
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 857: Loss = 0.179066464304924
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 858: Loss = 0.22975069284439087
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 859: Loss = 0.7660627365112305
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 860: Loss = 0.5304501056671143
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 861: Loss = 0.2428586184978485
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 862: Loss = 0.31947535276412964
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 863: Loss = 0.30893364548683167
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 864: Loss = 0.28968775272369385
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 865: Loss = 0.3070299029350281
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 866: Loss = 0.48516225814819336
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 867: Loss = 0.2679997980594635
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 868: Loss = 0.4933958947658539
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 869: Loss = 0.3899914026260376
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 870: Loss = 0.21959881484508514
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 871: Loss = 0.3229733407497406
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 872: Loss = 0.33561766147613525
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 873: Loss = 0.5851722359657288
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.446866, 'f1_score': 0.419565, 'precision': 0.540148, 'recall': 0.446866}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.803815, 'f1_score': 0.803669, 'precision': 0.803572, 'recall': 0.803815}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 38
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 874: Loss = 0.4462786912918091
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 875: Loss = 0.3682973384857178
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 876: Loss = 0.29806897044181824
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 877: Loss = 0.22708740830421448
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 878: Loss = 0.29644349217414856
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 879: Loss = 0.3652418851852417
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 880: Loss = 0.4790492355823517
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 881: Loss = 0.2940201163291931
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 882: Loss = 0.23932719230651855
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 883: Loss = 0.39380013942718506
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 884: Loss = 0.2923382818698883
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 885: Loss = 0.31379151344299316
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 886: Loss = 0.2859385013580322
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 887: Loss = 0.37857362627983093
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 888: Loss = 0.5538551211357117
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 889: Loss = 0.3478924632072449
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 890: Loss = 0.3781237006187439
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 891: Loss = 0.28873270750045776
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 892: Loss = 0.4810020327568054
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 893: Loss = 0.3632257580757141
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 894: Loss = 0.3706201910972595
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 895: Loss = 0.37735623121261597
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 896: Loss = 0.2594071626663208
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.566758, 'f1_score': 0.554137, 'precision': 0.616438, 'recall': 0.566758}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.784741, 'f1_score': 0.783862, 'precision': 0.819317, 'recall': 0.784741}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:251] INFO     []  Saving best model with metric: 0.554137
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 39
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 897: Loss = 0.21214792132377625
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 898: Loss = 0.23221002519130707
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 899: Loss = 0.29258063435554504
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 900: Loss = 0.3153616786003113
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 901: Loss = 0.36160242557525635
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 902: Loss = 0.24797199666500092
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 903: Loss = 0.3745613396167755
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 904: Loss = 0.2860516607761383
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 905: Loss = 0.30144554376602173
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 906: Loss = 0.3374176323413849
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 907: Loss = 0.221713125705719
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 908: Loss = 0.30828946828842163
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 909: Loss = 0.3282705843448639
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 910: Loss = 0.27279552817344666
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 911: Loss = 0.2546929717063904
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 912: Loss = 0.20636840164661407
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 913: Loss = 0.293432354927063
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 914: Loss = 0.31852322816848755
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 915: Loss = 0.2070728987455368
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 916: Loss = 0.259260892868042
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 917: Loss = 0.22275741398334503
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 918: Loss = 0.19191192090511322
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 919: Loss = 0.20208048820495605
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.457766, 'f1_score': 0.428978, 'precision': 0.517209, 'recall': 0.457766}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.784741, 'f1_score': 0.782707, 'precision': 0.784162, 'recall': 0.784741}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 40
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 920: Loss = 0.2567811608314514
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 921: Loss = 0.1965044140815735
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 922: Loss = 0.21782830357551575
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 923: Loss = 0.22624444961547852
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 924: Loss = 0.1632053554058075
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 925: Loss = 0.30869150161743164
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 926: Loss = 0.18386313319206238
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 927: Loss = 0.15238583087921143
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 928: Loss = 0.1381426602602005
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 929: Loss = 0.17780327796936035
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 930: Loss = 0.1685892790555954
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 931: Loss = 0.17458149790763855
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 932: Loss = 0.2260969877243042
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 933: Loss = 0.2827155888080597
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 934: Loss = 0.23431620001792908
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 935: Loss = 0.27383849024772644
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 936: Loss = 0.2289447784423828
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 937: Loss = 0.2812080383300781
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 938: Loss = 0.18156421184539795
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 939: Loss = 0.18054628372192383
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 940: Loss = 0.24134497344493866
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 941: Loss = 0.1658744066953659
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 942: Loss = 0.2683591842651367
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.542234, 'f1_score': 0.526419, 'precision': 0.580791, 'recall': 0.542234}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.833787, 'f1_score': 0.834305, 'precision': 0.839289, 'recall': 0.833787}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 41
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 943: Loss = 0.27701884508132935
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 944: Loss = 0.1868859827518463
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 945: Loss = 0.15229272842407227
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 946: Loss = 0.12096866220235825
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 947: Loss = 0.19302071630954742
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 948: Loss = 0.27827757596969604
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 949: Loss = 0.23277869820594788
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 950: Loss = 0.1948157101869583
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 951: Loss = 0.20050078630447388
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 952: Loss = 0.25233787298202515
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 953: Loss = 0.3404805362224579
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 954: Loss = 0.11792044341564178
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 955: Loss = 0.25197118520736694
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 956: Loss = 0.09205467998981476
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 957: Loss = 0.21033018827438354
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 958: Loss = 0.19265250861644745
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 959: Loss = 0.1843014806509018
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 960: Loss = 0.16368910670280457
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 961: Loss = 0.20203861594200134
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 962: Loss = 0.28115135431289673
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 963: Loss = 0.24387671053409576
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 964: Loss = 0.29524528980255127
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 965: Loss = 0.2668493390083313
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.591281, 'f1_score': 0.570827, 'precision': 0.653692, 'recall': 0.591281}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.822888, 'f1_score': 0.823617, 'precision': 0.830804, 'recall': 0.822888}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:251] INFO     []  Saving best model with metric: 0.570827
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 42
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 966: Loss = 0.19290244579315186
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 967: Loss = 0.16289560496807098
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 968: Loss = 0.11974181234836578
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 969: Loss = 0.24552002549171448
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 970: Loss = 0.2606601417064667
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 971: Loss = 0.3051469326019287
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 972: Loss = 0.16561701893806458
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 973: Loss = 0.1985754519701004
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 974: Loss = 0.19867072999477386
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 975: Loss = 0.20732897520065308
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 976: Loss = 0.18499088287353516
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 977: Loss = 0.1523667275905609
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 978: Loss = 0.2493465691804886
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 979: Loss = 0.20315030217170715
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 980: Loss = 0.37125301361083984
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 981: Loss = 0.1898900270462036
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 982: Loss = 0.15155094861984253
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 983: Loss = 0.1399998962879181
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 984: Loss = 0.13526245951652527
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 985: Loss = 0.24566227197647095
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 986: Loss = 0.23157688975334167
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 987: Loss = 0.22971875965595245
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 988: Loss = 0.24991880357265472
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.53951, 'f1_score': 0.509098, 'precision': 0.610248, 'recall': 0.53951}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.839237, 'f1_score': 0.838165, 'precision': 0.838663, 'recall': 0.839237}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 43
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 989: Loss = 0.21164648234844208
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 990: Loss = 0.21072837710380554
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 991: Loss = 0.16824494302272797
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 992: Loss = 0.11904580146074295
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 993: Loss = 0.1940723955631256
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 994: Loss = 0.18962743878364563
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 995: Loss = 0.2513110041618347
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 996: Loss = 0.15757226943969727
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 997: Loss = 0.09615433216094971
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 998: Loss = 0.13151440024375916
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 999: Loss = 0.2534450590610504
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1000: Loss = 0.20460371673107147
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1001: Loss = 0.13089311122894287
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1002: Loss = 0.11214331537485123
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1003: Loss = 0.2730812430381775
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1004: Loss = 0.21201585233211517
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1005: Loss = 0.267719030380249
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1006: Loss = 0.2322724461555481
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1007: Loss = 0.20554925501346588
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1008: Loss = 0.20886516571044922
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1009: Loss = 0.12558259069919586
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1010: Loss = 0.1743219941854477
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1011: Loss = 0.4073992669582367
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.457766, 'f1_score': 0.448461, 'precision': 0.570833, 'recall': 0.457766}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.779292, 'f1_score': 0.765861, 'precision': 0.804489, 'recall': 0.779292}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 44
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1012: Loss = 0.14550134539604187
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1013: Loss = 0.18124786019325256
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1014: Loss = 0.1361602246761322
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1015: Loss = 0.107267364859581
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1016: Loss = 0.16565662622451782
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1017: Loss = 0.3143507242202759
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1018: Loss = 0.23262010514736176
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1019: Loss = 0.16574755311012268
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1020: Loss = 0.1604669690132141
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1021: Loss = 0.15400394797325134
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1022: Loss = 0.1449744552373886
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1023: Loss = 0.15841545164585114
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1024: Loss = 0.12538188695907593
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1025: Loss = 0.16404832899570465
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1026: Loss = 0.17147287726402283
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1027: Loss = 0.2188311517238617
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1028: Loss = 0.2429705262184143
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1029: Loss = 0.15816351771354675
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1030: Loss = 0.1894790232181549
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1031: Loss = 0.1808847188949585
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1032: Loss = 0.17425058782100677
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1033: Loss = 0.11656483262777328
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1034: Loss = 0.19658635556697845
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.656676, 'f1_score': 0.651943, 'precision': 0.676061, 'recall': 0.656676}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.806539, 'f1_score': 0.796645, 'precision': 0.832896, 'recall': 0.806539}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:251] INFO     []  Saving best model with metric: 0.651943
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 45
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1035: Loss = 0.14919178187847137
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1036: Loss = 0.11376941949129105
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1037: Loss = 0.15064787864685059
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1038: Loss = 0.08310713618993759
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1039: Loss = 0.19344930350780487
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1040: Loss = 0.07990951836109161
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1041: Loss = 0.10349760949611664
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1042: Loss = 0.1864224076271057
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1043: Loss = 0.15037202835083008
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1044: Loss = 0.17669039964675903
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1045: Loss = 0.1423017978668213
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1046: Loss = 0.13094642758369446
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1047: Loss = 0.18320432305335999
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1048: Loss = 0.09219543635845184
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1049: Loss = 0.13179419934749603
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1050: Loss = 0.11730021983385086
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1051: Loss = 0.28635770082473755
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1052: Loss = 0.1904473900794983
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1053: Loss = 0.20258650183677673
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1054: Loss = 0.07178418338298798
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1055: Loss = 0.20985835790634155
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1056: Loss = 0.10842444002628326
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1057: Loss = 0.06563922762870789
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.580381, 'f1_score': 0.57213, 'precision': 0.646066, 'recall': 0.580381}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.852861, 'f1_score': 0.853562, 'precision': 0.860387, 'recall': 0.852861}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 46
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1058: Loss = 0.06749673187732697
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1059: Loss = 0.07998424768447876
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1060: Loss = 0.13825802505016327
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1061: Loss = 0.11673659086227417
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1062: Loss = 0.12929557263851166
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1063: Loss = 0.2426968365907669
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1064: Loss = 0.16309958696365356
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1065: Loss = 0.11148392409086227
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1066: Loss = 0.12550728023052216
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1067: Loss = 0.09040837734937668
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1068: Loss = 0.1552535444498062
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1069: Loss = 0.22094234824180603
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1070: Loss = 0.10311111062765121
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1071: Loss = 0.11665275692939758
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1072: Loss = 0.11955416947603226
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1073: Loss = 0.1701715886592865
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1074: Loss = 0.18561005592346191
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1075: Loss = 0.11530392616987228
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1076: Loss = 0.1016966700553894
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1077: Loss = 0.13176894187927246
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1078: Loss = 0.0831013172864914
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1079: Loss = 0.09981497377157211
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1080: Loss = 0.24999865889549255
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.509537, 'f1_score': 0.477725, 'precision': 0.573847, 'recall': 0.509537}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.839237, 'f1_score': 0.839566, 'precision': 0.84021, 'recall': 0.839237}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 47
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1081: Loss = 0.17470046877861023
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1082: Loss = 0.11072972416877747
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1083: Loss = 0.1169976145029068
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1084: Loss = 0.20386579632759094
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1085: Loss = 0.14408138394355774
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1086: Loss = 0.08537326753139496
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1087: Loss = 0.22720879316329956
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1088: Loss = 0.13311640918254852
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1089: Loss = 0.14620307087898254
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1090: Loss = 0.13126692175865173
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1091: Loss = 0.13145752251148224
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1092: Loss = 0.1203995794057846
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1093: Loss = 0.1954466998577118
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1094: Loss = 0.16295281052589417
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1095: Loss = 0.20757508277893066
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1096: Loss = 0.11811335384845734
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1097: Loss = 0.21742019057273865
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1098: Loss = 0.0900687575340271
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1099: Loss = 0.1005716621875763
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1100: Loss = 0.21649302542209625
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1101: Loss = 0.09554658830165863
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1102: Loss = 0.10966980457305908
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1103: Loss = 0.13943912088871002
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.572207, 'f1_score': 0.572194, 'precision': 0.6548, 'recall': 0.572207}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.850136, 'f1_score': 0.845995, 'precision': 0.861072, 'recall': 0.850136}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 48
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1104: Loss = 0.13179288804531097
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1105: Loss = 0.1253703236579895
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1106: Loss = 0.11056617647409439
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1107: Loss = 0.14462172985076904
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1108: Loss = 0.1957370936870575
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1109: Loss = 0.08671905100345612
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1110: Loss = 0.1049567461013794
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1111: Loss = 0.24772891402244568
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1112: Loss = 0.14325563609600067
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1113: Loss = 0.18346403539180756
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1114: Loss = 0.10606683790683746
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1115: Loss = 0.21512094140052795
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1116: Loss = 0.20379263162612915
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1117: Loss = 0.1323145478963852
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1118: Loss = 0.11289149522781372
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1119: Loss = 0.09970757365226746
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1120: Loss = 0.22685463726520538
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1121: Loss = 0.18459945917129517
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1122: Loss = 0.2899131178855896
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1123: Loss = 0.12051375210285187
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1124: Loss = 0.18403980135917664
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1125: Loss = 0.22048255801200867
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1126: Loss = 0.24895350635051727
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.53406, 'f1_score': 0.51389, 'precision': 0.589142, 'recall': 0.53406}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.847411, 'f1_score': 0.846822, 'precision': 0.847517, 'recall': 0.847411}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:230] INFO     []  Epoch: 49
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1127: Loss = 0.1285046935081482
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1128: Loss = 0.07343390583992004
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1129: Loss = 0.11549870669841766
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1130: Loss = 0.08684103935956955
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1131: Loss = 0.15326052904129028
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1132: Loss = 0.1610267609357834
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1133: Loss = 0.17615462839603424
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1134: Loss = 0.1219584196805954
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238]
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238]         View Tensorboard results in your browser with this command:
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238]             tensorboard --logdir=s3://oleg2-s3-mztdpcvj/metaflow/TrainHandGestureClassifier/187928/experiments/ResNet18/logs
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238]
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Best model checkpoint saved at s3://oleg2-s3-mztdpcvj/metaflow/TrainHandGestureClassifier/187928/experiments/ResNet18/best_model.pth
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1135: Loss = 0.1332458108663559
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1136: Loss = 0.2368752360343933
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1137: Loss = 0.1553899347782135
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1138: Loss = 0.23804913461208344
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1139: Loss = 0.07455451041460037
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1140: Loss = 0.10783593356609344
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1141: Loss = 0.09543832391500473
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1142: Loss = 0.24823057651519775
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1143: Loss = 0.25997626781463623
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1144: Loss = 0.12465868890285492
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1145: Loss = 0.06898175179958344
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1146: Loss = 0.13029171526432037
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1147: Loss = 0.14301300048828125
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1148: Loss = 0.13355281949043274
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:155] INFO     []  Step 1149: Loss = 0.3919955790042877
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for gesture
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.577657, 'f1_score': 0.565972, 'precision': 0.665441, 'recall': 0.577657}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:35] INFO     []  valid: metrics for leading_hand
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] [LINE:36] INFO     []  {'accuracy': 0.809264, 'f1_score': 0.807817, 'precision': 0.808172, 'recall': 0.809264}
     [187928/train/1013658 (pid 97705)] [bc964eed-17b8-4ad1-8f93-89960163c238] Task finished with exit code 0.
     [187928/train/1013658 (pid 97705)] Task finished successfully.
     [187928/end/1013659 (pid 98045)] Task is starting.
     [187928/end/1013659 (pid 98045)] Task finished successfully.
     Done!

In this lesson, you learned how to do transfer learning with PyTorch to access and iterate on state-of-the-art models. You then saw how Metaflow helps you access GPUs in the cloud while addressing common issues when setting up your workflows for remote computing tasks. Metaflow provides access to compute, takes care of the networking between the data and compute environments, and versions all results so they can be accessed later.

In the next lesson, we will level up the ability to iterate on this model effectively. Specifically, you will learn how to save a model checkpoint in the cloud and then resume training from that point. See you there!