mdsutilities Discussions Rss Feed

New Post: Services for getting data with related entities

dbrowne — Wed, 16 Jan 2013 16:55:54 GMT

Great, glad to hear it. Just for completeness sake, the subscription views are efficient for the following kinds of lookups:

-Lookup entities by Name

-Lookup entities by Code

-Lookup entities by the value of a Domain Attribute

A lookup of an entity by a non-domain attribute that is not Code or Name generally requires a scan of the entire entity table. If you have only a few thousand entity members this is probably fine, but if you have millions of entity members this can get expensive.

David

New Post: Services for getting data with related entities

sachbat — Wed, 16 Jan 2013 16:50:04 GMT

Hi David

Just wanted to thank you agan for giving the idea, i have done a WCF web service to the subsription view, i created and its a drastic improvement. Iwas taking 12 sec through MDS and now its taking 600 millisecs.

Thanks again

Sachin

New Post: Services for getting data with related entities

sachbat — Mon, 14 Jan 2013 04:40:14 GMT

Thanks David for a good suggestion.

I will try this tomorrow and let you know if I have any problems and the performance improvement.

Thanks

Sachin

Sent from my iPhone

On Jan 11, 2013, at 3:58 PM, "dbrowne" <notifications@codeplex.com> wrote:

From: dbrowne

For improved performance retrieving entity data (for a single entity or across entites), consider bypassing the MDS web services APIs and reading data either directly from the Subscription Views, or populating an read-only relational model in SQL Server that materializes the canonical attributes of your master data entities.

If you design a simple relational schema and load that periodically from your subscription views, you can easily build Web Services with EF and WCF or WCF Data Services that are very fast and scalable.

David

New Post: Services for getting data with related entities

dbrowne — Fri, 11 Jan 2013 20:58:16 GMT

For improved performance retrieving entity data (for a single entity or across entites), consider bypassing the MDS web services APIs and reading data either directly from the Subscription Views, or populating an read-only relational model in SQL Server that materializes the canonical attributes of your master data entities.

If you design a simple relational schema and load that periodically from your subscription views, you can easily build Web Services with EF and WCF or WCF Data Services that are very fast and scalable.

David

New Post: Services for getting data with related entities

sachbat — Fri, 11 Jan 2013 20:25:15 GMT

Hi David

Your CRUD web service generator utility is very helpful. What i am trying to achive now is how can i write a service for getting the data from related enitities because in your utility or in any other example we just get data from an entity.

I already tried getting data from different entity and wrote logic in .NET to get what i want and then form a object and expose as WCF service but the calls to different related entities is taking too much time.

So in short what i am asking is either a way to improve the performance if we have to make individual calls to different entities or any other way to get the data as a service from related entities.

Any help will be appreciated as always..

Thanks

Sachin

New Post: Inserting into entities with FK Relationship & transactions

sachbat — Wed, 31 Oct 2012 19:39:23 GMT

Hi David

Thanks for your suggestion.

Thanks

Sachin

New Post: Inserting into entities with FK Relationship & transactions

dbrowne — Wed, 31 Oct 2012 19:28:22 GMT

You can hit Entity Based Staging from your app. You may not get great concurrency when hitting the staging tables from your code.

For instance you can put a stored procedure in another database on the same instance (or run a TSQL batch), something like:

create procedure [dbo].[insertSTATUS] (@code nvarchar(255), @name nvarchar(255), @description nvarchar(255) )
as
/*
BEGIN TRANSACTION
delete from mds2012.stg.STATUS_Leaf
exec [insertSTATUS] 'asdfadsf','abcdef', 'dkfjdkj'
select *
from mds2012.stg.viw_STATUS_MemberErrorDetails
select * from mds2012.stg.STATUS_Leaf 
ROLLBACK
*/
begin
    set nocount on
    declare @batchTag nvarchar(50) = cast(newid() as nvarchar(50))
    INSERT INTO mds2012.[stg].STATUS_Leaf  ( ImportType, BatchTag, Code,  Name, Description  )
    SELECT 2, @batchTag, @code, @name, @description

    EXEC mds2012.stg.udp_STATUS_Leaf  'VERSION_1', @BatchTag=@batchTag
    declare @ed nvarchar(255)
    declare @ec int;
    select @ed = errorDescription , @ec = UniqueErrorCode
    from mds2012.stg.viw_STATUS_MemberErrorDetails
    where batchTag = @batchtag
    delete from mds2012.stg.STATUS_Leaf where BatchTag = @batchTag
    if @ec < 50000 
        set @ec = 50001
    if (@ed is not null)
    begin
      throw  @ec, @ed, 1;
    end

end

New Post: Inserting into entities with FK Relationship & transactions

sachbat — Wed, 31 Oct 2012 18:23:53 GMT

Hi David

Thanks for your reply, i will have to do it through web services as i need to create members in entities as soon as they are creted in our CRM system in Dynamics.

Can i do Entity Based Staging Live? I mean not though SSIS. The only way i am aware of doing Entity Based Staging is though SSIS which will run like a job once, twice or n number of times daily but it will not be live.

If you have any suggestions please let me know.

Thanks

Sachin

New Post: Inserting into entities with FK Relationship & transactions

dbrowne — Wed, 31 Oct 2012 18:01:05 GMT

MDS will not allow an entity to be loaded with an invalid domain-based attribute. So you generally need to load the entities in the correct order.

Also the MDS web services do not support transactions. Each call to the web services is atomic. Your options are

1) Use a TransactionScope for your _other_ transactional resources and commit or roll them back based on whether the MDS operations succeed.

2) Use the MDS transaction tracking function to implement compensating transactions in case of failure.

3) load data through Entity-Based Staging, which is transactional, instead of the Web Services

David

New Post: Inserting into entities with FK Relationship & transactions

sachbat — Wed, 31 Oct 2012 16:09:01 GMT

Hi David

I am having issues while inserting members in entities with FK Relationship (Domain Based) using CRUD Web Services. Is there any way which takes care of that or do we have to handle it based on whihc entity goes forst and then which entity after that.

Secondly i wanted to ask you if i am handling the inserts into entities on my own, i want to use Transactions. I tried using TransactionScope in C# but thats not working. Do you have any recommendations for this or any other way i can achieve this.

Please let me know

Thanks

Sachin

New Post: Using MDSEntityCCRUDOperation Add Entity - how can i get the code generates in MDS

sachbat — Mon, 22 Oct 2012 13:20:54 GMT

Hi David

Thanks for replying back, it took me some time while waiting for you but i figured that. Its good that you took some time as i did it myself and after you replied i am confirmed what i did was right.

Thanks again !!!

Sachin

New Post: Using MDSEntityCCRUDOperation Add Entity - how can i get the code generates in MDS

dbrowne — Thu, 18 Oct 2012 21:28:12 GMT

Good catch. That API needs an update for the Autogenerated code functionality.

Checked it in and AddMember now looks like this:

    public string AddMember(string code, IDictionary<string, object> values)
    {
      return AddMember(CreateMemberFromAttributes(code, values));
    }
    protected string AddMember(Member member)
    {

      var members = new EntityMembers() { Members = new List<Member>(1) };
      members.ModelId = new Identifier() { Id = ModelId };
      members.VersionId = new Identifier() { Id = VersionId };
      members.EntityId = new Identifier() { Name = EntityName };

      members.Members.Add(member);
      OperationResult rc;
      var ids = client.EntityMembersCreate(new International(), members,true,out rc);
      if (rc.Errors.Count > 0)
      {
        throw new InvalidOperationException(rc.Errors[0].Description);
      }

      return ids[0].Code;
    }

David

New Post: Using MDSEntityCCRUDOperation Add Entity - how can i get the code generates in MDS

sachbat — Thu, 18 Oct 2012 18:09:51 GMT

Hi David

I am using your MDSEntityCRUDOperations.cs and after adding the entity i would like to know how can i get the code which is generated automatically in the entity assuming i have code auto generated specified in MDS.

Thanks

Sachin

New Post: How to use CRUD WebService

sachbat — Wed, 25 Jul 2012 16:35:59 GMT

http://xxxxxx/Service/Service.svc? is running fine. Its running on a remote server (virtual server)

I am the administrator on my machine.

New Post: How to use CRUD WebService

dbrowne — Wed, 25 Jul 2012 16:31:34 GMT

Can you open a browser and navigate to http://xxxxxx/Service/Service.svc? Is MDS running locally or on a remote server?

You might try running Visual Studio with elevation.

David

New Post: How to use CRUD WebService

sachbat — Wed, 25 Jul 2012 16:27:45 GMT

Hi David

Thanks for getting back, i am getting "Access is denied error" if i debug the solution i get "SOAP security negotiation with 'http://xxxxxx:81/Service/Service.svc' for target 'http://xxxxxx/Service/Service.svc' failed. See inner exception for more details.

"{"The Security Support Provider Interface (SSPI) negotiation failed."}" as the inner exception.

Thanks

Sachin

New Post: How to use CRUD WebService

dbrowne — Wed, 25 Jul 2012 16:23:47 GMT

And what is the error you are getting?

David

New Post: How to use CRUD WebService

dbrowne — Wed, 25 Jul 2012 16:21:57 GMT

This discussion has been copied to a work item. Click here to go to the work item and continue the discussion.

New Post: How to use CRUD WebService

sachbat — Tue, 24 Jul 2012 13:56:02 GMT

Hi David

I would like to know how can i use the CRUD web service. I tried to download your project and change the servoce reference to mine but it doesn't work. It throws errors, is there any way you can provide me with the steps for doing it. I am not an expert in .NET but i can certainly try things if you can guide me.

Thanks

Sachin

New Post: Does this project still works on 2008 R2 ?

dbrowne — Tue, 17 Jul 2012 16:45:24 GMT

Just as noted on the front page. The new custom workflow stuff from the 2012 version would probably work on 2008 R2.