Jason Collier & Jared Gradle - PowerPoint Presentation

Slide1
Slide2

Jason Collier & Jared GradlePremier Field EngineerMicrosoft Corporation

Archiving with Lync Server 2013

SERV401Slide3

Jason Collier

Lync Premier Field EngineerNorth America Technology Lead for Lync

Based in Seattle, WA

IP Contributor for the following

Lync Roll Out and Adoption Success Kit

Lync Server 2013 Workload Poster

Lync Server 2013 Networking Guide: Network Panning, Monitoring and Troubleshooting with Microsoft Lync Server

Masters Trainer and Author of the following classes

Lync Server 2013 Advanced Core workshop

Workshop - Lync Server 2013:

Administration

workshop

Workshop - Lync Server 2013: Advanced

Core

workshop

Workshop - Exchange 2013 Unified

Messaging

workshop

Workshop - Lync Online: Administration and

Configuration

workshopSlide4

Jared Gradle

Senior Lync Premier Field Engineer

Based in Dallas,

Tx

.

Part-time professional

IP Contributor for the following

Lync 2010 Resource Kit book (Presence and Instant messaging)

DR Res contributor.

Info

I started supporting Lync with LCS 2005. In my spare time I enjoy brewing beer, mountain biking, long walks on the beach, and Jason's sunny demeanor. Slide5

Outcome?

To understand the new features, capabilities and considerations when deploying the Lync Server 2013 Archiving feature, and what to take into account when the Lync Server 2013, Persistent Chat role is deployed.Slide6

It’s All About ArchivingSlide7

Why do we Archive?

Company Policies and ProceduresAppropriate use policiesHuman Resources Complaints

Required by Law, Policies or Oversight

Federal Trade Commission

– FTC

Financial Industry Regulatory Authority - FINRA

Securities and Exchange Commission - SEC

Health Insurance Portability and Accountability Act - HIPAA

Sarbanes-Oxley Act SOXSlide8

Archiving with 2010Slide9

It’s All About Archiving

Lync Server 2010Archiving was deployed using a middle-tier Architecture. Lync Servers communicated with the Archiving Server and the Archiving Server communicated with the Back-End Databases.

A

Front End

Server

MSMQ

RTCSRV.exe

(

Archiving

Agent)

A

MSMQ

Lcslog

queue

CDR and QOE

Archiving

Service

(

RTCArch.exe

)

SQL Server Instance

Lcslog

Database

Archiving

ServerSlide10

What’s changed and why?Slide11

What’s changed and why?

We’ve improved deployment and operational efficienciesCollocation of Archiving on Front End servers

Microsoft Exchange Integration

SQL Store Mirroring

Archiving of Whiteboard and PollsSlide12

Why add Exchange Integration?

Exchange has a proven record for handling complianceOne common experience for administrators

Leverage existing disk infrastructure

Leverage processes and tools around compliance and eDiscovery

Consistent story if using Exchange On-Premise or in the cloudSlide13

Integration OptionsSlide14

Lync Server Archiving

databases

Uses SQL store to archive IM data

Conferencing data is stored on the Pool or Standard Edition Servers file store

Not discoverable or viewable, can be exported

Exchange 2013 integration

I

n-place Hold users are archived into Exchange

Exchange Archiving Policies override Lync Archiving Policies

Use SharePoint 2013 Discovery Center to search against the data

Integration Options

Data storage platformSlide15

It’s All About ArchivingSlide16

It’s All About Archiving

What’s ArchivedPeer-to-peer IM conversationsMultiparty IM conversations (

C

onferences)

Conference content, including uploaded

content

Polls and Whiteboards shared during a Conference

What’s Not Archived

Peer-to-peer file transfers

Audio/video for peer-to-peer

Instant Messages or conferences

Application sharing for peer-to-peer

Instant Messages or conferences

Persistent Chat conversations

Partner Solutions*

http

://technet.microsoft.com/en-us/lync/hh972602.aspxSlide17
Slide18

Fabric and LySS

FabricUsed to synchronize data between servers

Data is replicated from the Primary, to the Secondary and Tertiary

Fabric and

LySS

together

LySS

is utilizing Fabric, data resiliency occurs for data that is in transit

Synchronized dynamically between the Secondary and Tertiary

No administrator involvement, it’s just Fabric Magic!Slide19

Delegation of Archiving Administration

CsArchivingAdministrator roleEnable delegation of administrative tasks while maintain organizational security standards

Permissions to create, edit and delete Archiving Policies

Permissions to create, edit and delete Archiving Configuration

Exchange Integration

Configuration of Exchange Policies requires appropriate Exchange permissionsSlide20

Archiving with SQLSlide21

It’s All About Archiving

Lync Server 2013The Archiving Server role has been deprecated

Unified Data Collection Agents

responsible for capturing data are located on all Front End and Standard Edition Servers

Full support for SQL Mirroring, configured directly in Topology Builder

MSMQ has been replaced by Lync Storage Service

A

Front End

Server

LySS

RTCSRV.exe

(

Archiving

Agent)

SQL Server Instance

Lcslog

DatabaseSlide22

Components and Topologies for Archiving

Archiving AgentsAlso known as Unified Data Collection agents

Installed and activated automatically

Archiving

data storage

SQL Server Store

Exchange 2013 Storage

File storage

Required for Archiving regardless of data storage

Uses the same file storage as the Front End Servers of Standard Edition servers

Store conferencing (Meeting) content data storage and file storageSlide23

Supported Collocation

LcsLog can be collocated with Monitoring Database or Back-End Database

Can share a SQL instance with other databases, but size should always be planned and considered

Each SQL instance can only have one

Back-end database

Monitoring database

Archiving database

Supported versions of SQL

SQL Server 2008 R2 Standard or Enterprise or SQL Server 2012 Standard or Enterprise

SQL Server Express is not supported

SQL Server Clustering or Always-On is

not

supported

SQL Server Clustering is supported in a migration scenariosSlide24

Enabling Archiving with SQL

Three steps to enable Archiving to a SQL Store

Define SQL Store

Associate SQL Store

Enable Archiving for Internal and/or external communicationsSlide25

Define a new SQL StoreSlide26

AssociationsSlide27

Archiving Policies

Enable Archiving for …Internal CommunicationsExternal Communications

Both Internal and External CommunicationsSlide28

Archiving Policies

Global Archiving policySite Archiving policyUser Archiving policy

Internal

Communications

External Communications

Both Internal and External

CommunicationsSlide29

Archiving Configuration

Global Archiving ConfigurationSite Archiving Configuration

Pool Archiving ConfigurationSlide30

Archiving Configuration Options

Archive SettingsDisable ArchivingArchive IM Sessions

Archive IM and web conferencing sessions

Block IM or Web Conferencing

Exchange Server Integration

Enable PurgingSlide31

Archiving with Exchange 2013Slide32

Exchange 2013 Architecture

Two Server RolesClient Access Server Role

Mailbox Server Role

Other roles are now services

Client Access Server

Client Access Front End

Frontend Transport

also includes the Unified Messaging Call Router Service, which is new for Exchange 2013

Mailbox Server

Mailbox

Client Access

Unified Messaging

Hub TransportSlide33

How do we Integrate with Exchange?

It takes two: Trust and PermissionsTrust is established using Server-to-Server

Oauth

Certificates used to establish the Trust

OAuth

certificates are replicated automatically using the CMS

Exchange uses self-signed certificate, distribution occurs during setupSlide34

How do we Integrate with Exchange?

It takes two to make it happen: Trust and PermissionsPermissions are established using New-

CsPartnerApplication

Cmdlet

Permissions need to be established within Lync, Exchange and SharePoint (for eDiscovery)Slide35

Enabling Archiving with Exchange

User Policies Order of PrecedenceFor users on Exchange 2013 on In-Place hold the Exchange Archiving Policies override Lync Server archiving policies

Two steps to enable Archiving with Exchange

1. Enable

Exchange Server Integration

2. Enable Archiving for internal and/or external communications

3. Configure

ExchangeArchivingPolicy

property for each user* (this step is only required if Lync and Exchange are deployed into separate forests)Slide36

Enabling Archiving with Exchange

Lync Server Control PanelSlide37

Enabling Archiving with Exchange

Lync Server Management ShellSet-

CsArchivingConfiguration

-Identity

“Global

" -

EnableArchiving

ImOnly

-

EnableExchangeArchiving

$True

IM

only is archived to

Exchange

Set-

CsArchivingConfiguration -Identity

“Global" -EnableArchiving ImOnly -EnableExchangeArchiving

$False IM only is archived to SQLSet-CsArchivingConfiguration -Identity

“Global" -EnableArchiving

None -EnableExchangeArchiving $True Nothing will be archivedSlide38

Enabling Individual Users to Exchange

UninitalizedArchiving based on In-Place Hold settings configured for users Exchange mailbox

The Lync User Replicator will see if the user is for

InPlaceHoldEnabled

= True value

UseLyncArchivingPolicy

Archive in Lync rather than in Exchange

NoArchiving

Nothing will be

archived. This overrides any Lync Server archiving policies assigned to the user

ArchivingToExchange

Archive regardless if the user is on In-Place hold or notSlide39

Exchange Archiving primer

Lync > Exchange (where does my data go)Lync archives data to the Purges folder which is a hidden folder within the Recoverable Items folder.

This folder is not user accessible. It’s accessible by an administrator via OWA or via other mechanisms discussed later.

Data Retention

Exchange archiving policy generically apply to the mailbox and do not apply to data with the Recoverable Items folder. Deleted item retention and Legal hold apply to data within the recoverable items folder.

Example: Exchange archiving policy is set to 12 months. Deleted Item retention is set to 21 days. Lync IM conversations will not be archived longer than 21 days. Unless legal hold has been applied to the mailbox. Slide40

Enabling Individual Users to Exchange

Lync Server Management ShellSet-

CsUser

-Identity "Ken Myer" -

ExchangeArchivingPolicy

ArchivingToExchange

Get-

CsUser

| Where-Object {$_.

ExchangeArchivingPolicy

-ne "

UseLyncArchivingPolicy

"} | Select-Object

DisplayName

Get-

CsUser -Filter {RegistrarPool

-eq "atl-cs-001.litwareinc.com"} | Set-CsUser -ExchangeArchivingPolicy

ArchivingToExchange

Get-CsUser | Where-Object {$_.ExchangeArchivingPolicy -

eq "Uninitialized"} | Select-Object DisplayNameSlide41

Archiving with Office 365Slide42

Lync online Multi-tenant

Provides

archiving of peer-to-peer instant messages, multiparty instant messages, and content upload activities in meetings.

Exchange is required and Archiving is

controlled by the user’s Exchange mailbox In-Place Hold attribute, which archives both email and Lync contents

.

No direct control of archiving from within the Lync admin console.

Archiving is only available if your plan includes Exchange Online or if you have a hybrid deployment.

No Exchange = No archivingSlide43

Lync Online Dedicated

SQL database is utilized for archiving

Unlike Multi-tenant environments SQL server (

LCSLog

) is utilized for archived content.

Your organization will need to subscribe to the Lync Online archiving and monitoring features.

Daily snapshots are taken of the product Archiving database.

Data is retained for 60 days in a read only copy of the database.

Connectivity to the databases is secured using SSL. Standard SQL connectivity tools such as the Open Database Connectivity specification (ODBC), SQL Management Studio, and Microsoft Office and can be used for data access.Slide44

Options only available with Management ShellSlide45

Options only available with LSMS

New-, Get-, Set- Remove-CsArchivingConfiguration

PurgeHourOfDay

ArchinveDuplicateMessages

CachePurgingInterval

Export-

CsArchivingDataSlide46

Options only available with LSMS

PurgeHourOfDayLocal time of day to run database purge from

LcsLog

Value uses military time

Default is 2:00 AMSlide47

Options only available with LSMS

ArchiveDuplicateMessagesConversations span two pools

User1 on Pool1

User2 on Pool2

Archived both sides of the conversation if set to True, otherwise just the OrganizerSlide48

Options only available with LSMS

CachePurgingIntervalPurge every X hours for users not enabled for Archiving

Range is 4 to 168 hours

Default is 24 hoursSlide49

Disclaimers …Slide50

Archiving Disclaimer

Send of an Archiving Disclaimer to Federated PartnersWhen you deploy an Edge and enable Federation

Automatically send archiving disclaimer to federated partnersSlide51

DemoConfiguration Options in Lync Server Control PanelSlide52

Accessing the DataSlide53

SQL Store

LcsLogCannot change the database name

Database

is not searchable

Database is not in a readable format

Export-

CsArchivingData

extracts records

Files are stored as EML Files

Export using Export-

CsArchivingData

Export-

CsArchivingData

-Identity "ArchivingDatabase:atl-sql-001.litwareinc.com" -

StartDate

6/1/2012 -

OutputFolder "C:\ArchivingExports"Export-CsArchivingData -Identity "ArchivingDatabase:atl-sql-001.litwareinc.com" -StartDate 6/1/2012 -OutputFolder "C:\ArchivingExports" -UserUri "kenmyer@litwareinc.com"Export-

CsArchivingData -Identity "ArchivingDatabase:atl-sql-001.litwareinc.com" -StartDate 6/1/2012 -EndDate 6/30/2012 -OutputFolder "C:\ArchivingExports"Slide54

Exchange Storage

Where are the messages?Mailbox > recoverable Items > Purges

End-users can’t access via OWA or Outlook

Accessible via Multi Mailbox Search toolSlide55

DemoFederated Search with SharePoint 2013 and Exchange 2013Slide56

What about Persistent Chat?Slide57

Persistent Chat Compliance

Define a SQL storeAssociate with Topology BuilderSlide58

Persistent Chat Changes

Compliance service is no longer standaloneRuns on all Persistent Chat servers

Provides high availability of the compliance service in a multi server pool

MSMQ is a private queue

Shared by the Compliance Service and the Persistent Chat service

All compliance services right to the same Compliance Back End database

Compliance Back End Server

Now represented as a Back End Server RoleSlide59

Persistent Chat Compliance Configuration

New-, Get- and Set-CsPersistentChatComplianceConfiguration

AdapterName

Name of the Persistent Chat adapters used by the compliance settings. Adapters are third-party products that convert the data in the compliance database to a specific format.

AdapterOutputDirectory

Full path to the folder where adapter data is stored. You must have a separate folder for each adapter.

AdapterType

Specifies the fully qualified name of a

.Net

managed type that implements the

compliance adapter

interface. This adapter is supplied by a third-party or can be set to the internal XML adapter, Slide60

Persistent Chat Compliance Configuration

New-, Get- and Set-CsPersistentChatComplianceConfiguration

AddChatRoomDetails

When set to True, additional details about each chat room are provided to the adapter. This has the potential to greatly increase the size of the compliance data.

The default value is False.

AddUserDetails

When set to True, additional details about each chat room user are provided to the adapter. This has the potential to greatly increase the size of the compliance data.

The default value is False.

CreateFileAttachmentsManifest

When set to True, additional output files will be created to track file transfers within chat rooms. These files will have the file extension .ATTACH and are placed in the location specified by the

AdapterOutputDirectory

.

CustomConfiguration

XSLT transform script that enables Persistent Chat to save compliance data in a custom format of your design.

InMemory

Creates an object reference without actually committing the object as a permanent change. If you assign the output of this

cmdlet called with this parameter to a variable, you can make changes to the properties of the object reference and then commit those changes by calling this cmdlet’s matching Set- cmdlet.

OneChatRoomPerOutputFileWhen set to True, separate reports are created for each chat room. The default value is False.RunIntervalAmount of time that the server waits before generating the next output file. The RunInterval must be specified using the format days.hours:minutes:seconds. For example, to specify a RunInterval of 30 minutes (the default value) use this syntax:

-RunInterval 00:30:00The RunInterval can be set to any value between 1 minute (00:01.00) and 30 days (30.00:00:00), inclusive. The default value is 15 minutes (00:15:00).Slide61

Persistent Chat Compliance Configuration

New-, Get- and Set-CsPersistentChatComplianceConfiguration

CustomConfiguration

XSLT transform script that enables Persistent Chat to save compliance data in a custom format of your design.

InMemory

Creates an object reference without actually committing the object as a permanent change. If you assign the output of this

cmdlet

called with this parameter to a variable, you can make changes to the properties of the object reference and then commit those changes by calling this

cmdlet’s

matching Set-

cmdlet

.

OneChatRoomPerOutputFile

When set to True, separate reports are created for each chat room. The default value is False

.Slide62

Persistent Chat Compliance Configuration

New-, Get- and Set-CsPersistentChatComplianceConfiguration

RunInterval

Amount of time that the server waits before generating the next output file. The

RunInterval

must be specified using the format

days.hours:minutes:seconds

. For example, to specify a

RunInterval

of 30 minutes (the default value) use this syntax:

-

RunInterval

00:30:00

The

RunInterval

can be set to any value between 1 minute (00:01.00) and 30 days (30.00:00:00), inclusive. The default value is 15 minutes (00:15:00).Slide63

DemoArchiving Persistent ChatSlide64

Notes from the FieldSlide65

Notes from the Field

Exchange Storage and SQL Store togetherWhen migrating users to Exchange 2013, both data stores can be used on an interim basis.

Permanent use of both Exchange and SQL Store for archiving is not supported

SQL Store is not a long term retention solution

Customer archived one years of data into

LcsLog

Decided to enable purging of all chats older than 14 days

Had purge in “chunks” to prevent outages

SharePoint Discovery Center Results duplicated

This is by design, one from the archive and one from the Conversation History folderSlide66

Notes from the Field

Keep Archiving store near your poolEnsure you have a capable connection between the Lync Pool and either the SQL back end or Exchange Server to handle the LYSS throughput

Transport Configuration Settings

MaxReceiveSize

and

MaxSendSize

will control/restrict the size of attachments in meetings, plan and adjust accordingly.

Transport Configuration Settings

MaxReceiveSize

and

MaxSendSize

will control/restrict the size of attachments in meetings, plan and adjust accordingly.Slide67

Partner SolutionsSlide68

Partner Solutions

Lync’s Strengths are reinforced by the Partner EcosystemNot all organizations requirements are the same

Our native solution may not meet your requirements

Where to look?

Actiance

–

www.actiance.com

AudioCodes

–

www.audiocodes.com

Instant

Tech -

www.instant-tech.com/Archive_Viewer_OCS.cfm

MindLink

Software –

www.mindlink.com Slide69

Free Solutions

OCS Archiving ReportWorks with Lync Server 2010Uses SQL Server Reporting Services

http://

blogs.technet.com/b/dodeitte/archive/2010/02/19/ocs-archiving-report-released.aspx

OCS IM Archive Viewer

Works with Lync Server 2010

Only Retrieves IMs, not messages sent in a Conference.

http

://

blogs.technet.com/b/drrez/archive/2011/06/07/office-communications-server-2007-r2-tool-ocs-im-archive-viewer.aspxSlide70
Slide71

Microsoft Pavilion

Demos, Speakers, Demos,

Lync Room System,

Experts,

Demos, a Bar....and more DemosSlide72

ATTENDEE PARTY

Wednesday, February 19

th

6:30pm-9:30pm

Hakkasan

, MGM Grand

Brought to you by

When it comes to Vegas nightclubs, it doesn’t get any hotter than

Hakkasan

. And when it comes to opportunities to connect and reasons to party, no one does it better than Lync Conference!

Our attendee party has a full lineup: an open bar, awesome food, and one of the best DJs that Vegas has to offer. Don’t miss out on the fun—stop by at 6:30pm and kick off and evening to remember. Come together.Slide73

HANDS-ON LABS

Tuesday, February 18

th

5:00pm – 7:00pm

You can also access labs on

MyLync

!

3:00pm – 9:00pm

10:30am – 9:00pm

7:30am – 9:00pm

8:00am –1:30pm

LOCATION

Pinyon

3

Monday, February

17

Tuesday

, February

18

Wednesday

, February 19

Thursday

, February

20

LRS

LOCATION

Copperleaf 12

Wednesday, February 19

8:30am – 9:45am

10:15am

– 11:30am

1:00pm

– 2:15pm

2:45pm – 4:00pm

4:30pm – 5:45pm

Thursday, February 20

9:00am

–

10:15am

10:45am – 12:15pm

12:45pm – 2:00pmSlide74

MyLync

allows you to create a custom experience and network with the Lync Community both online and in person.

With

MyLync

, you can:

Build your own personalized calendar while browsing all available sessions

View breakout session material including PPTs and Videos within

48 hours of each session

Participate in the Community and find people in your social networks

who are attending and interact with speakers

Arrange meetings or social activities

Navigate the Exhibit Hall floor plan and learn more about our Sponsors

Fill out evaluations to win prizes

Log into

MyLync

at

http://mylync.lyncconf.com

For

MyLync

support, please visit the Registration Desk.*

* Please note that adding a session to your calendar does not reserve a seat. Seating is on a first-come, first-served basis.Slide75

Birds of a Feather

Birds

of a Feather flock together! Join daily breakfast discussions of relevant topics by sitting in the separately designated areas of the Meal Hall.

Seating

will be sorted in a different way for each Birds of a Feather breakfast:

Wed

ne

sday, February 19:

Where are you from?

Asia/Pacific, Eastern & Central Europe, Latin America, Middle East & Africa, US (West, Central & East) and Canada, Western Europe

Thursday, February 20:

What is your interest?

Best Practices, Business Value, Clients & Mobility,

Lync Meetings and Video, Lync Online, Networking, Platform, Server & Manageability, VoiceSlide76

Fill out evaluations

to win prizes

Fill out evaluations on

MyLync

or

MyLync

Mobile.

Prizes awarded daily.Slide77

©

2013

Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.

The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.