Once the Nokia deal closes, Nokia smartphones running the Windows Phone OS will be further improved, boosting Microsoft's stable of devices, he said. Microsoft expects the deal, estimated at around $7.2 billion, to be finalized in the first calendar quarter of next year.
"We have a big upside opportunity in devices," Ballmer said.
Windows' small share in the smartphone and tablet markets is one of the biggest criticisms leveled at Ballmer in recent years, as Apple's iOS and Google's Android seized market opportunities. Microsoft's attempts to recover lost ground in this sector includes the decision to make its own tablet, the Surface, and to radically redesign its flagship OS with an interface optimized for touch screens in Windows 8.
The first generation of both Windows 8 and the Surface tablets, launched about a year ago, failed to deliver the success Microsoft had expected, but the company isn't giving up, hoping that the Surface 2 line of tablets and the Windows 8.1 update -- both released recently -- will address customers' main complaints.
Ballmer also said the broad corporate restructuring he unveiled in July is "under way ... we're operating with a single strategy and starting to work as a single team," he said.
That reorganization, referred to as One Microsoft, is intended to make Microsoft function more cohesively and stamp out in-fighting among the different product teams.
As part of the restructuring, Microsoft dissolved its five business units -- the Business Division, which housed Office; Server & Tools, which included SQL Server and System Center; the Windows Division; Online Services, which included Bing; and Entertainment and Devices, whose main product was the Xbox console. It replaced them with four engineering groups organized by function, around operating systems, applications, cloud computing and devices, and by centralized groups for marketing, business development, strategy and research, finance, human resources, legal and operations.
Ten years from now, people will look back amazed at how "primitive" technology was in 2013 and how Microsoft went on to lead the way and achieve greatness, he said.
"I'm optimistic. I treasure my Microsoft stock," Ballmer said. "I'm confident we have the right strategy in place."
Ballmer also said the company plans to complete its integration of Skype and Lync in the next three to six months. Skype is Microsoft's unified communications product for consumers and small businesses, while Lync is its enterprise counterpart. Microsoft wants to make them fully interoperable.
The question-and-answer period with investors wasn't a lovefest but it was civil.
One shareholder expressed skepticism about recent big acquisitions, and said he wasn't enthusiastic about the Nokia deal, because in his view the phone maker has struggled against competitors in recent years and isn't in good financial shape.
Ballmer acknowledged that some big acquisitions have been failures, like the $6 billion deal for the aQuantive ad network in 2007, but said Microsoft can't shy away from pursuing these large deals if it deems them necessary to remain competitive and go after new opportunities. The Nokia deal makes absolute sense as part of the "devices and services" push and also because the two companies have been working together on smartphones and the teams know how to collaborate, he said.
Another shareholder questioned Microsoft's marketing strategy for Windows 8, saying it doesn't do a good job of letting people know the compelling new features it has. Ballmer said he welcomed suggestions on how to improve the business, in particular Windows 8 sales.
When the issue of the company's stock price was raised -- a sore point for many shareholders because it has fallen during Ballmer's tenure -- Ballmer said the focus needs to be on the company's competitiveness and on its financial health, and that the share price will reflect those two elements.
All of the ballot questions posed to shareholders were approved according to the board's recommendations, including the re-election of all nine board members.
Juan Carlos Perez covers enterprise communication/collaboration suites, operating systems, browsers and general technology breaking news for The IDG News Service. Follow Juan on Twitter at @JuanCPerezIDG.