Can I bring a discrimination claim if I have only worked somewhere for a few weeks?

Yes.

Unlike unfair dismissal, discrimination claims under the Equality Act 2010 have no minimum length-of-service requirement.

You can bring a discrimination claim from your first day of employment.