I want to get the order of Users table on the basis of roles.. for example if user has three roles its comes first, then user of two roles comes and so on her it is my query but it gives order to role table not parent table

$users = User::with(['roles'=>function($query){
        $query->orderBy('id','desc');
    }])->get();
    dd($users);