Magnetic susceptibility, high field magnetization and specific heat measurements on Ce5Rh3 are reported. Two antiferromagnetic transitions are observed at T(N)=4.5 K and T(N)'=2.6 K. The magnetization curve at 1.5 K reveals a nontrivial magnetic structure in this compound, with a saturation magnetization of 0.72mu(B). The high temperature Curie constant (0.64 emu K/mol), the Curie-Weiss constant (THETA(p)=-45 K) and the entropy related with the magnetic transitions (DELTAS(m)=0.8 R In 2) indicate the presence of a Kondo-type component in the ground state of Ce5Rh3.