Counting the number of grape bunches at an early stage of development offers relevant information to the winegrower about the potential yield to be harvested. However, manual counting on the fields is laborious and time-consuming. Remote sensing, and more precisely unmanned aerial vehicles mounted with RGB or multispectral cameras, facilitate this task rapidly and accurately. This research paper was performed using the open-source dataset available at: https://doi.org/10.1016/j.dib.2022.108848. It contains 40 RGB videos from a 1.06-ha vineyard located in northern Spain. Moreover, the dataset includes mask labels of visible grape bunches. Lastly, the dataset has already been used to perform grapevine phenotyping in grape bunches and berries: https://doi.org/10.1016/j.compag.2023.108051.