Visualizing uploaded data from deeplake UI

[snat1505027]

Hi, I am a new deeplake user. I am trying to upload my data from local machine to the Deeplake UI so that I can visualize the data easily from the UI. I am using the following code:

import pathlib
import numpy as np
import os
import json


def construct(choices):
    text_choices = []
    for ch in choices:
        text = ""
        for c in ch:
            if isinstance(c, list):
                c = [str(x+1) for x in c]
                text += (', '.join(c)+' ')
            else:
                text += (c+' ')
        text_choices.append(text.strip())
    return text_choices

@deeplake.compute
def file_to_deeplake(file_name, sample_out, class_names):
  
    
    img = deeplake.read('./vcr1images/'+file_name['img_fn'])
   
    try:
        sample_out.append({"label": np.uint32(file_name['answer_label']),
                           "images": img,
                           "question": file_name['question_orig'],
                           "answer": file_name['answer_orig'],
                           "rationale": file_name['rationale_orig'],
                           "answer_choices": construct(file_name['answer_choices']),
                           "rationale_choices": construct(file_name['rationale_choices']),
                           "objects": file_name['objects'],
                           "img_fn": file_name['img_fn'],
                           "annot_id": file_name['annot_id']
                          })
    except:
        print(file_name, class_names)

val_data = []

with open('/./VCR/val.jsonl', 'r') as f:
    for line in f:
        val_data.append(json.loads(line)) 

CLASS_NAMES = [0,1,2,3]

ds = deeplake.empty('./VCR', overwrite=True)
with ds:
 
    ds.create_tensor('images', htype = 'image', sample_compression = 'jpg')
    
    ds.info.update(description = 'Visual Commonsense Reasoning')
    ds.commit('Empty')
    file_to_deeplake(class_names=CLASS_NAMES).eval(val_data[:10], ds, num_workers = 1)
    ds.commit("Uploaded all images")

But I can not see any data in my homepage of https://app.activeloop.ai/. Can you please suggest what I am missing? Thanks!

[mikayelh]

hi there @snat1505027, we will look right into this!

[davidbuniat]

@snat1505027 thanks for posing the question! You would need to create the dataset using hub path on the cloud.

ds = deeplake.empty(f'hub://{username}/VCR', overwrite=True)

otherwise if dataset has been already created locally you can also transfer it to the cloud.

deeplake.deepcopy('./VCR', f'hub://{username}/VCR')