Whip the cream cheese and 1/2 cup sugar in the bowl of a stand mixer until smooth. Add the cream and vanilla extract and whip until stiff peaks form.
In a small bowl, toss the strawberries and blackberries with the 2 tbsp sugar and allow to sit.
To assemble, place the pound cake cubes at the bottom of a trifle bowl or in individual cups. Top with some of the strawberry blackberry mixture, followed by a layer of the cream cheese mixture. Add some raspberries and blueberries and repeat layering as needed. Chill until ready to serve.