The image of St Francis Xavier, together with the statues of the Immaculate Conception (NG P 205) and St. John of Nepomuk (NG P 192), adorned the altar of the Novo Celje (Plumberk) Mansion chapel until 1930. In that year, the last owner of the Mansion transferred the statues to Zagreb, where they were acquired by Dr. Fran Windischer and donated to the National Gallery. They represent one of the topmost achievements of Baroque sculpture in the territory of the Republic of Slovenia.
The chapel's furnishings were part of the extensive reconstruction of the old Plumberk Mansion, which Anton Count Gaisruck transformed into his new residence, called Novo Celje Mansion. He hired established artists for the furnishings – the Wessobrunn stucco artist Joseph Göbhardt who made plans for the altar architecture, the painter Anton Jožef Lerchinger of Rogatec who furnished the chapel with paintings, the sculptural decoration was contributed around 1760 by the leading Graz sculptor Veit Königer, while the gilding is the work of the Graz painter Franz Josef Reich.
The sculptor was paid 540 gold coins for the work, which included, among other things, two telamons with the attributes of Heracles in front of the main entrance and statues of nymphs for the staircase of the Mansion (nowadays in the National Museum of Slovenia).
Because of the flask and the scallop shell the figure was previously identified as St James, but both the clothing and the facial features do not follow the established depictions of the saint, who appeared with long hair and a long beard. In recent publications, Polona Vidmar suggests the identification with the popular Jesuit saint St Francis Xavier in the image of a pilgrim, who stood on the right side of the altar in the chapel, and his gestures directed the gaze of the believer towards the Immaculate Conception.