With his dad now in the custody of the Justice Department, Frank Hayashi’s mother, sister, and broth