Square’s shares rose up to 7% on Tuesday after the company officially started banking this week.

The company’s share closed 4.6%.

Square’s new wholly owned bank will offer FDIC-insured deposit accounts and loans to small businesses who have used the company in the past to process payments.

Square Financial Services, based in Salt Lake City, announced Monday that it will initially focus on offering business loan and deposit products, starting with the underwriting and lending of business loans for Square Capital’s existing loan product.

Prior to its launch, Square Capital loans were made through a partnership with Celtic Bank.

“By leveraging bankability internally, we can move faster, which will benefit Square and our customers, if we continue to work on creating financial instruments that serve the underserved,” Square CFO Amrita Ahuja said in a statement .

The company had spent more than four years starting a bank, and Square received regulatory approval in March last year. “We do not expect the bank to have a material impact on Square’s consolidated balance sheet, total revenue, gross profit or Adjusted EBITDA in 2021,” the company said.

While this is currently only happening on the merchant side, the move signals Square CEO Jack Dorsey’s broader ambition to turn the tech company into a one-stop-shop for finance. Square can also look back on many years of experience in building fast-growing products internally. The Cash app, which started as a smaller in-house project, now accounts for roughly half of Square’s gross profit.

Square’s move paved the way for other fintechs looking to shut down the middleman in banking. The fintech company Sofi applied for a national bank charter last year. But the version Square went on – an industrial loan charter, or ILC – has been pushed back by banking lobbyists in the past. The industry has criticized it as a way for companies to bypass rules that have historically separated banking and commerce.

Subscribe to CNBC on YouTube.